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(54) Efficient and secure update of software and data 



(57) The invention concerns apparatus for updating 
a data file, from an earlier version to a later version. The 
invention compares the earlier version with a later ver- 
sion, and derives a transformation, which contains infor- 
mation as to the similarities and differences. The 
invention then processes the earlier version, using the 
transformation, in order to derive the later version, with- 
out reference to the later version itself. 



The invention allows multiple versions of an original 
file, such as bank records located at multiple locations, 
to be updated by transmitting the transformation to the 
multiple locations, instead of transmitting the updated 
files themselves. The procedure is highly resistant to 
interception of the updated data, because the transfor- 
mation, in general, does not contain the entire contents 
of the later versions. 
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Description 

An APPENDIX is attached which contains source code used by the invention. The invention concerns a method for 
remotely updating software or data, or both, which reduces the amount of data transmitted, and is less susceptible to 
s interception. 

Background of The Invention 

Electronic data transmission between computers via a common-carrier telephone system requires speed and secu- 
re rity. Transmission speed can be enhanced by compressing the data before transmission, while security can be protected 
using encryption. Data compression is also beneficial for encryption because it reduces redundancy in the data source, 
and increases resistance to cracking attempts. 

However, if a data file is compressed and encrypted, the resulting compressed-and-encrypted data is based on a 
single source. Data compression and encryption based on single data sources are not perfect. Unless great redundancy 
15 exists in the data, compression does not perform well, and high-speed computers working together with modern crypto- 
analytic methods can crack most encrypted data. 

In many situations, multiple later versions of an initial data source are frequently transmitted after slight changes in 
the data. The fact that the changes are slight means that all versions are inherently similar. The inherent similarity can 
be exploited to compute a minimal transformation that transforms one version into another. 
20 This process of computing such a transformation is called data differencing. Data differencing enhances transmis- 
sion speed because it reduces the amount of data to be communicated. It also enhances privacy because a snooper 
without the earlier version cannot deduce too much information from the transmitted data. 

A number of compression and differencing techniques have been previously considered. The article "A Universal 
Algorithm for Sequential Data Compression," by J. Ziv and A. Lempel, contained in IEEE Transactions on Information 
25 Theory, 23(3): pp. 337 - 343, May, 1 977, describes a technique to compress a single data file. This works by analyzing 
a data sequence and, at each position, if possible, identifying the longest segment that matches another segment in the 
already analyzed part. Such a segment, if found, is encoded using the matching position and the length of the match. 
Unmatched data are output as-is. 

An implementation of this algorithm was the subject of U.S. Patent number 4,464,650, August 7, 1984, by W.L. 
30 Eastman, A. Lempel, and J. Ziv. The Eastman- Lempel-Ziv compression method is slow on de-compression because it 
has to do roughly the same amount of work during de-compression as during compression, it also does not apply to 
data differencing. 

On UNIX systems, differences between text (not binary) files can be computed using the program "diff," which 
produces a set of lines that must be deleted or added to transform the first file to the second. The "diff" approach can 

35 produce very large transformations because small changes in text lines cause them to be considered different. Further, 
it only works on text files, so it has a limited range of applicability. 

The article 'The String-to-String Correction Problem with Block Moves," by Walter F. Tichy, contained in ACM Trans- 
actions on Computer Systems, 2(4): pp. 309 - 321 , November, 1 984, describes an algorithm to compute a set of instruc- 
tions called block-moves to transform one version of a data file to another. A block-move is a data segment in the second 

40 version that matches another segment in the first version. This algorithm is essentially unrealized and does not take 
advantage of any redundancy inherent in the second version to minimize the transformation needed to construct the 
second version from the first version. 

Summary of The Invention 

45 

In one form of the invention, a computer program compares a first and a second, later, version of a file, and produces 
a sequence of instructions. The instructions allow replication of the second version, based on the first version. 

The instructions are of two types: One type is a COPY instruction, which orders copying of a specified sequence of 
characters into a file being constructed. The specified sequence can reside either in the first version, or in the file under 
so construction. 

The second type is an ADD instruction, which orders addition of a sequence of characters, which accompanies the 
ADD instruction. When the instructions are executed in sequence, they produce a concatenation of sequences, which 
are COPIED and ADDED, producing a replica of the second version. 

55 Brief Description of The Drawings 

Figure 1 is a schematic of how the invention is used for data communication between computers. 
Figures 1 A through 1 1 explain, by analogy, principles used by the invention. 
Figure 1 J illustrates a security aspect of the invention. 
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Figure 2 gives an example of two versions of a data set and a set of instructions to transform one of the versions to 
the other. 

Figures 2A through 2E illustrate operation of the procedure described in Figure 3. 

Figures 2F through 2H illustrate operation of the procedure described in Figure 5. 
s Figure 3 describes the decoding procedure in a pseudo-C language. 

Figure 4 shows the actual encoding of the instructions of Figure 2. 

Figure 5 describes the encoding procedure. 

Figure 6 describes the INSERT procedure used in Figure 5. 

Figure 7 describes the SEARCH procedure used in Figure 5. 
w Figure 8 describes the EXTEND procedure used in Figure 5. 

Figure 9 shows the inserted positions of the example VERSION1 and VERSION2 data of Figure 2. 

Figure 10 shows the secure version of the coded instructions of Figure 4. . 

Detailed Description of The Invention 

75 

A simplified analogy will explain some of the more fundamental aspects of the invention. A technical explanation of 
computer code which implements part of the invention is given later, beginning in the section entitled 'The Invention". 

Analogy 

20 

Assume that a newspaper reporter and a newspaper editor are writing an article together, but at different locations. 
Assume that they both have written VERSION 1, which is shown in Figure 1 A. Assume that the reporter has made the 
changes shown in Figure 1 B, resulting in VERSION 2, which is shown in Figure 1C (the boxes indicate the locations of 
changes), and wishes to send this version to the editor. The following procedure will allow the reporter to send VERSION 
25 2 to the editor, but without sending the entire contents of VERSION 2. 

Procedure 

First, the reporter assigns a position to each word in VERSION 1 , as indicated in Figure 1 A. There are 50 positions, 
30 conesponding to the 50 words. 

Second, the reporter ascertains the vocabulary of VERSION 1 . The vocabulary is a list, or table, of the words used, 
as indicated in Figure 1 A. Note that each word appears in the vocabulary only once. For example, the word "them" at 
position 18 is not entered into the vocabulary, because this word previously appeared, at position 16. 

In order to assure that each word appears only once, the reporter, as each word is entered, checks to see whether 
35 that word already exists in the table. For example, the reporter enters the first word, "when." Then, the reporter takes 
the word at position 2, "buying,*' and checks it against the first word in the vocabulary, namely, "when". There is no match, 
so the reporter enters "buying" into position 2 in the vocabulary. 

The reporter proceeds in this manner until the word "them" is reached at position 18. When checking this word 
against the previous 17 entries in the vocabulary, the reporter finds that "them" matches "them" at position 16 in the 
40 vocabulary. Consequently, the latter "them" is not entered into the vocabulary, because it would duplicate the previous 
"them." 

When the last word in VERSION 1 is checked for matches, the vocabulary becomes complete. VERSION 1 , which 
is 50 words in overall length, contains only 38 different words, as indicated by the length of the vocabulary. 

Next, the reporter establishes a vocabulary for VERSION 2, as shown in Figure 1C. VERSION 2 has the same 
45 vocabulary as VERSION 1 , with the exception of three additional words, indicated as NEW WORDS. Now the reporter 
is ready to transmit VERSION 2 to the editor. 

The reporter transmits VERSION 2 by transmitting the following six messages, or instructions, each of which will 
be explained by a respective Figure in Figures 1 D - 1 1: 

so 1. COPY 2 1 

2. ADD 1 Hawaiian 

3. COPY 3 3 

4. ADD 1 all 

5. COPY 37 8 
55 6. ADD 2 a brick. 
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Instruction 1 

By pre-arrangement, the reporter and the editor set a POINTER at position 1, as indicated in Figure 1D. The first 
instruction, "COPY 2 1" means "COPY the sequence of 2 words which begin at position 1 in VERSION 1." (In each 
5 instruction, it is implicit that the words are placed at the POINTER in VERSION 2.) This operation is shown in Figure 1 D. 
Note that the syntax is 

COPY [number of words, starting position in VERSION 1], 
After following the instruction, the editor moves the POINTER by the "number of words" in the COPY instruction, 
which, in this case, is 2. The POINTER is now located as shown in Figure 1E. 

10 

Instruction 2 

Instruction 2 states "ADD 1 Hawaiian," which means "ADD the one word 'Hawaiian'." This operation is shown in 
Figure 1 E. Note that the syntax is 
15 ADD [number of words, words themselves]. 

After following the instruction, the editor moves the POINTER by the "number of words" in the ADD instruction, 
which, in this case, is 1 . The POINTER is now located as shown in Figure 1 F. 

Instruction 3 

20 

The third instruction, "COPY 3 3" means "COPY the sequence of 3 words which begin at position 3 in VERSION 
1 ." This operation is shown in Figure 1 F. Note that the syntax is identical to that of instruction 1 . 

After following the instruction, the editor moves the POINTER by the "number of words" in the copy instruction, 
which, in this case, is 3. The POINTER is now located as shown in Figure 1G. 

25 

Instruction 4 

Instruction 4 states "ADD 1 all," which means "ADD the one word 'all'." This operation is shown in Figure 1G. 
After following the instruction, the editor moves the POINTER by the "number of words" in the ADD instruction, 
30 which, in this case, is 1 . The POINTER is now located as shown in Figure 1 H. 

Instruction 5 

The fifth instruction, "COPY 37 8" means "COPY the sequence of 37 words which begin at position 8 in VERSION 
35 1 ." This operation is shown in Figure 1 H. Note that the syntax is identical to that of instruction 1 . 

After following the instruction, the editor moves the POINTER by the "number of words" in the copy instruction, 
which, in this case, is 37. The POINTER is now located as shown in Figure 1 1. 

Instruction 6 

40 

Instruction 4 states "ADD 2 a brick," which means "ADD the 2 words 'a brick'." This operation is shown in Figure 1 1. 
Now VERSION 2 has been constructed. 

Significant Features 

45 

VERSION 2, shown in Figure 1 C, contained 43 words, which themselves contained 163 characters. However, the 
set of six instructions contained 27 characters, plus the instructions themselves (ie, COPY and ADD). If each instruction 
and each character is encoded as one byte, then the total message equals 27 + 6 characters, or 33 characters. Trans- 
. mitting 33 characters takes a significantly shorter time than transmitting 1 63 characters. 

50 

The Invention 

The previous analogy was a simplification, and does not illustrate all of the features of the invention. Figure 2 illus- 
trates two VERSIONS of a file, together with a TRANSFORMATION, which allows construction of VERSION2 from the 
55 combination of VERSION1 and the TRANSFORMATION itself. The procedure shown in Figure 3 accomplishes the 
reconstruction, and will now be explained. First, the general pattern will be elaborated. 

As background, four important points should be recognized. One, each character in each VERSION occupies a 
numbered position, as shown in Figure 2A. For example, in VERSION 1 , the first "a" occupies position 0. The first "b" 
occupies position 1 , and so on. 
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Two, the numbered positions in VERSION 2 begin after the highest-numbered position in VERSION 1. Thus, since 
the highest position in VERSION 1 is "15," VERSION 2 begins with "16." 

Three, a pointer (which is a variable in the procedure of Figure 3) indicates a current position, as indicated in Figure 

2A. 

5 Four, the TRANSFORMATION contains instructions. There are two types of instruction, namely, ADD and COPY 
The operation of these two instructions will be explained by showing how VERSION 2 is constructed from VERSION 1 . 

Instruction 1 

10 In Figure 2B, instruction 1 of the TRANSFORMATION is executed. This instruction, "COPY 4 0," states, in effect, 
" COPY the FOUR characters beginning at position ZERO in VERSION 1 to the pointer in VERSION 2." (The underlined 
words refer to the words in the instruction: FOUR refers to 4, and so on.) Figure 2B illustrates the operation. 

It is significant that/ in this instruction, the characters used to generate VERSION 2 are obtained from VERSION 
1 , not from the instruction itself. Thus, if the instruction were obtained via a telephone transmission, an eavesdropper 
75 would obtain no information usable in constructing VERSION 2 because the eavesdropper is presumed to have no 
access to VERSION 1. 
The syntax is 
COPY [number of characters, starting position] 

20 Instruction 2 

In Figure 2C, instruction 2 is executed. This instruction, "ADD 2 x,y," states, in effect, " ADD the TWO characters x 
and y to VERSION 2, beginning at the pointer." 

It is significant that, in this instruction, the characters used to generate VE RSION 2 are obtained from the instruction 
25 itself. Consequently, an eavesdropper does obtain some information about VERSION 2. However, in practice, this type 
of instruction is expected to be intermixed with so many types of COPY instructions (which contain no information) that 
the eavesdropper would obtain no significant information about VERSION 2. 

Nevertheless, it is possible, in theory, that the TRANSFORMATION may contain ADD instructions exclusively, in 
which case the eavesdropper would obtain VERSION 2 in its entirety. Or the number of ADD instructions may be very 
30 large. To prevent an eavesdropper from obtaining information from these ADD instructions, an encryption option is pro- 
vided, which is discussed later. 

The syntax is of the ADD instruction is 
ADD [number of characters, characters themselves] 

35 Instruction 3 

In Figure 2D, instruction 3 is executed. This instruction, "COPY 6 20", in effect, states: 
generate a COPY which is six characters long, using the characters residing between position TWENTY and the 
pointer, and place them at the pointer. 
40 The result is the sequence xyxyxy, as indicated. 

(As another example, if the COPY statement read "COPY 6 19", then it, in effect, would have stated 
generate a COPY, which is sjx characters long, using the characters residing between position NINETEEN (not 
TWENTY) and the pointer, and place them at the pointer. 

The sequence added at the pointer would have been dxydxy, because the sequence residing between position 
45 nineteen and the pointer is dxy.) 

It is significant that, in this instruction, the characters used to generate VERSION 2 are obtained from VERSION 2 
itself. Thus, it is now seen that the COPY instruction uses two sources, depending on the address specified. In this 
instruction, the address (ie, the "20" in "COPY 6 20") indicates VERSION 2 (ie, the address is greater than 1 5). VERSION 
2 is the source for this command. 
so In contrast, if the address were 15 or less, then VERSION 1 would have been used as the source. 

This approach, in effect, allows one to expand the vocabulary, using ADD instructions. Then, when VERSION 2 is 
found to contain characters which are (a) not in VERSION 1 , but (b) contained in the expanded vocabulary (because 
added earlier), a COPY instruction can be used. The COPY instruction has two benefits. 

One is that a COPY instruction can insert a large number of characters, merely by indicating their total number, and 
55 starting position. In contrast, the ADD instruction requires the characters themselves to be transmitted, which entails a 
longer transmission. 

A second is that, as discussed above, the COPY instruction contains no information, unless an interceptor of the 
instruction also happens to possess VERSION 1 . 
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Instruction 4 

In Figure 2E, instruction 4 is executed. This instruction, "COPY 5 9," in effect, states: " COPY the FIVE characters 
beginning at position NINE in VERSION 1 ." This instruction resembles instruction 1 . 

5 

Reference to Process of Figure 3 

Figure 3 illustrates a process by which a computer can construct VERSION 2 from the combination of VERSION 1 
and the TRANSFORMATION. 

w In Figure 3, line 2 initializes a variable c, which is used to compute the pointer shown in Figures 2B - 2E. The pointer 
is computed in lines 9, 13, and 14, as appropriate. 

Instruction 1 

15 Instruction 1 (COPY 4 0) of the TRANSFORMATION shown in Figure 2 is executed in line 13 in Figure 3. The 
variable "p" indicates the starting position of the source data, is obtained from the instruction, and equals 0. Since "p" 
is less than "n" (line 12), the source lies in VERSION 1. Consequently, line 13 is executed, because of the IF-statement, 
and the data is copied from VERSION 1, beginning at position VERSION1+p, which is position 0. The variable V 
indicates the. number of characters, is obtained from the instruction in line 7, and equals 4. 

20 The pointer is updated on line 16. 

Instruction 2 

Instruction 2 (ADD 2 x,y) is executed on line 9, because of the IF-statement on line 8. It places a sequence of 
25 characters, which is of length "s" (which equals 2) at the location VERSION2 + c. The pointer is updated on line 16. 

Instruction 3 

Instruction 3 (COPY 6 20) is executed on line 14, because of line 12: "p" (obtained from the instruction, and which 
30 equals 20) is less than "n." The copy function uses VERSION2 as the source, beginning at VERSION2 + c. The copy 
function takes a sequence which is s characters long. (The variable "s" is obtained from pointer-minus-20. The "20" is 
obtained from the instruction.) 

Instruction 4 

35 

Instruction 4 is executed on line 13, like instruction 1 . 

Generation of TRANSFORMATION 

40 Figure 5 contains a procedure which examines each VERSION, character-by-character, and generates the set of 
instructions which allows construction of VERSION 2 from the combination of VERSION 1 and the instructions, which 
are called a transformation. The transformation of Figure 2 was discussed above. The general approach taken by this 
procedure is the following. 

45 Run 1 

VERSION 1 is processed first. VERSION 1 is shown at several locations in Figure 2F The code of Figure 5 asks 
whether the four-character sequence beginning at position 0 matches a four character sequence beginning at a previous 
position. Of course, since nothing exists prior to position 0, the answer is No. Tlius, position 0 is flagged with a carat, as 
so indicated in the row labeled RUN 1. 

Run 2 

On the second run, the code asks a similar question, namely, whether the four-character sequence beginning at 
55 position 1 matches a four-character sequence beginning at a previous position. The answer is No, and a flag is placed 
at position 1. 



3/21/2007, EAST Version: 2.1.0.14 



EP0717353 A2 



Runs 3 and 4 

In a similar way, flags are placed at positions 2 and 3, resulting in the flagging shown at RUN 4 in Figure 2F. 
5 Run5 

Run 5 produces different results. In RUN 5, the code asks the usual question, Does the four-character sequence 
beginning at position 4 match a four-character sequence beginning at a previous position ? The answer is Yes, at position 
0, as indicated in the row labeled RUN 5. Position 4 is not flagged, and the EXTEND function (line 16, Figure 5) is called 
10 into action. 

The EXTEND function asks how long the match extends. It asks whether the next position after the matched block 
(the matched block occupies positions 4 - 7, so the next is position 8) has a match located four positions earlier. The 
answer is Yes, as indicated in trial TA. 

It then asks whether the second position after the matched block, position 9, has a match located four positions 
75 earlier. The answer is again Yes, as indicated by trial TB. This inquiry continues until a position is reached, in trial TE, 
where no such match is found. 

The EXTEND function has thus ascertained that the match extends for eight positions, from position 4 through 
position 1 1 . Because of the logic of the code, the last three positions of the extended match are flagged, namely, the 
"BCD" located in "RUN 5 RESULT." 

20 

Run 6 

Run 6 asks whether the four-character sequence beginning at position 12 (ie, the rightmost "e") matches any four- 
character sequence beginning at a position occurring previously. The answer is No, and a flag is placed at position 12, 
25 as indicated in the row labeled RUN 6. 

Results 

The results are shown at the bottom of Figure 2F, and labeled RESULT. Two important features are the following: 
30 One, as will be later explained, the flags indicate not only the beginnings, but also the endings, of possible 

sequences which are used to construct VERSION 2. 

Two, there are regions which are not flagged, as indicated. A search for sequence to use in constructing VERSION 
2 never begins in these regions, although the search can begin outside these regions, and then invade the region. Thus, 
since initial search points are eliminated, the overall searching time is reduced. 

35 

Processing of VERSION 2 
First Four Runs 

40 VE RSION 2, the updated version, is processed next. The code asks whether the four-character sequences beginning 
at positions 16, 17, 18, and 19, shown in Figure 2G, have matches which begin at previous positions. The four-character 
sequence beginning at position 1 6 matches with that beginning at 0, but the latter three do not, so positions 1 7, 1 8, and 
19 are flagged, as indicated at the top of Figure 2G. 

The EXTEND function finds no extended match. The code of Figure 5 jumps to line 29, where it issues the "COPY 
45 4 0" instruction, which was explained above, and appears in Figure 2. 

The overall results are indicated by the arrow labeled OUTPUT Three characters have been flagged, and a COPY 
instruction has been issued. It is important to note that these flagged characters are later treated as search initialization 
points, just as are the flagged characters in VERSION 1 . 

so Run 5 

The code of Figure 5 asks whether the four-character sequence "xyxy", beginning at position 20 (which resides in 
VERSION 2, shown in Figure 2G, in the section labeled RUN 5), has a match which begins at a previous position. The 
code searches, starting at each flag, including those now existing in VERSION 2. 
55 Further, at each flag, the code searches both forward and backward. (This forward-backward searching was not 
mentioned previously, for simplicity.) The overall searching is indicated by RUN 5 in Figure 2G. Because the searching 
(a) starts with each flag and (b) searches for four characters, both forward and backward, every four-character sequence 
of trial T1 through T12 is examined. In addition, similar searching is done, starting with thef lagged positions in VERSION 
2, namely, positions 17, 18, 19, and 20. 
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No match is found, so the V at position 20 is flagged. 
Run 6 

s The code of Figure 5 asks whether the four-character sequence "yxyx", beginning at position 21 (which resides in 
VERSION 2), has a match which begins at a previous position. As for position 20, the code searches, forward and 
backward, beginning at each flag, including those in VERSION 2. No match is found, so position 21 is flagged. The 
current flagging is indicated at the upper right part of Figure 2H. 

10 Run 7 

The code of Figure 5 asks whether the four-character sequence "xyxy", beginning at position 22 (which resides in 
VERSION 2), has a match which begins at a previous position. The answer is Yes, at position 20. Thus, position 22 is 
not flagged, as indicated in Figure 2H, and the EXTEND function (line 16 of Figure 5) is entered. 
is The EXTEND function determines, in the manner described in connection with Figure 2F, that the match extends 
through position 27 in Figure 2H. Consequently, the last three positions of the extended match are flagged, resulting in 
the flagging shown in the box at the lower left of the Figure. 

At this time, the logic proceeds to line 29 of Figure 5, wherein the two instructions "ADD 2 x,y" and "COPY 6 20" 
are issued. (The arguments "add" and "c" in line 29 refer to the ADD instruction. The arguments "pos" and "len" refer to 
20 the COPY instruction.) 

Run 8 

The code asks whether the sequence "bcde", beginning at position 28 (See OUTPUT box in Figure 21), has a match 
25 beginning at a previous position. The answer is Yes, at position 9 in VERSION 1 (see Figure 2G, upper left). Now the 
EXTEND function is called, which determines that the match extends to an additional character, the T. 

The code, at line 29, then issues the instruction "COPY 5 9". The four instructions of Figure 2 have been generated. 
VERSION 2 can now be reconstructed from VERSION 1 , plus the instructions. 

30 Characterization 

The preceding overview illustrates the following principles: 
ONE, once it is determined that a position represents a previously matched sequence, that position is not flagged, 
and consequently, subsequent searches are not initiated at that position, because such initiation would be redundant. 
35 Thus, a reduced set of searching positions is obtained (if possible). 

TWO, VERSION 2 is constructed from two types of sources, namely, (a) sequences copied from either VERSION 
1 or VERSION 2 and (b) sequences ADDED to VERSION 2. Further, the ADDED sequences can be used later, in 
copying operations. 

From another point of view, if a first user possesses VERSION 1 , and if a second user possesses both VERSION 
40 1 and VERSION 2, the first user can construct a replica of VERSION 2, rf the second user identifies the following 
sequences of characters: 

(a) those to be copied from the first user's VERSION 1 . (b) those to be added to first user's VERSION 1 , and 
(c) those to be copied from the first user's replica of VERSION 2. 

45 

THREE, each flagged position represents the starting point of a possible vocabulary word. Analogous words are 
shown in Figure 1A. However, unlike the vocabulary of Figure 1 A, the vocabulary of each flagged position represents 
numerous possible sequences. 

For example, assume VERSION 1 is the following: 
so abcdeFghijk. 

If the upper-case F (position 6) is flagged, then it can represent the following sequences: 

f fg fgh fghi fghij fghijk. 
These sequences can contain other flagged positions. 

Therefore, a single flagged position can represent multiple sequences for copying into VERSION 2. Thus, this flagged 
55 position can appear in multiple COPY instructions. For instance, "COPY 3 6" means COPY "fgh." "COPY 5" means 
COPY "fghij". 
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Security Aspects 

As mentioned above, the ADD instructions contain information as to the content of VERSION 2, and this information 
may need security protection. One approach to security is shown in Figure 1 J. 
5 The ADD instruction of Figure 2 ("ADD 2 x,y"), which is sent, is modified to contain a pointer to a location within 
VERSION 1 . This modified instruction is labeled INSTRUCTION SENT in Figure U This pointer is "2", which indicates 
the V. 

The information sent (ie, the bytes representing V and "y") is then EX-ORed with the data beginning with the "c". 
Figure 1 J, left side, indicates the EX-OR operation. The instruction sent is "ADD 2 2" plus the result of the EX-OR 
10 operation. This EX-OR result contains no information of value to an eavesdropper, because the eavesdropper has no 
access to VERSION 1. 

The data contained in the received instruction, indicated on the right side of Figure 1 K, is EX-ORed with the same 
data in VERSION 1, namely, that which begins with the V. This EX-ORing recovers the original data, namely "x,y". 
This procedure exploits a property of the EX-OR operation, namely, that EX-ORing a first word with a second word 
is produces a third word. ED-ORing the third word with the second recovers the first. 
Thus, from the transmitted instruction, which is 
ADD 2 2 [EX-OR result], 
one obtains 

ADD 2 x,y, 
20 which is the intended instruction. 

Important Considerations 

1. The order in which the COPY and ADD instructions occur is, of course, important. If they are scrambled as to 
25 order, a different VERSION 2 will be obtained. 

From another perspective, the sequence itself is a type of information. The sequence can be viewed as a per- 
mutation of the instructions. The permutation contains information, just as permutations of the English alphabet 
create words, which convey information. 

Of course, the instructions could be transmitted in a scrambled order, if information is included which allows 
30 reconstruction of the sequence. For example, each instruction could be numbered. 

Irrespective of how execution of the proper sequence of instructions is attained, the execution produces a replica 
of VERSION 2, by a concatenation process. That is, returning to the example of Figures 2B through 2E: 

1 . First "abed" is written into the replica (Figure 2B). "abed" is taken from VERSION 1 . 
35 2. Then "xy" is concatenated (Figure 2C). "xy" is obtained from VERSION 1, 

3. Then "xyxyxy" is concatenated (Figure 2D), "xyxyxy" is obtained from VERSION 2. (Alternately, four pairs of 
"xy" could have been taken from VERSION 1 and concatenated in step 2. This would be less efficient, however.) 

4. Then "bedef" is concatenated (Figure 2E). "bedef " is obtained from VERSION 1. 

40 2. Further regarding Consideration Number 1 , above, the Inventors point out that each COPY and ADD instruction 
contains the length of the passage to be COPIED or ADDED. Thus, for any given COPY or ADD instruction, the 
address within VERSION 2 where the COPYING or ADDING occurs can be readily computed, based on the total 
preceding lengths. (The code of Figure 3 illustrates this, because the pointer is computed based on these lengths.) 

45 3. The invention can be used to update any type of data file. It is not limited to text files, or to files of other specific 
types. It can handle binary files generally. 

Files contain characters. Each character is commonly represented by a byte of data. Since a byte contains eight 
bits, 2&, or 256, possible characters can be represented by one byte. 

In "text" files, all of these possible combinations are not used. Only those representing alphanumerics, and 
so some punctuation, are used. 

In "binary" files, all possible 256 combinations are used. The invention can handle binary files. In contrast, 
differencing programs of the prior art can handle only text files. 

4. The invention is not limited to remote replication of VERSION 2 from a stored VERSION 1. In addition, a later 
55 version of a program can be stored at a single location, by using the ADD and COPY instructions, rather than storing 
the version in its entirety. This approach will save storage space. When a version is desired to be reconstructed, 
the program of Figure 3 is executed. 
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5. It is not necessary that the version of a file which is reconstructed be the actual, chronologically later version of 
an earlier file. For example, VERSION 1 can be reconstructed from VERSION 2. 

Technical Discussion 

5 

A more technical discussion of the code given in Figures 3 and 5 will now be given. 
Overview 

10 A data file can be considered as a sequence of bytes. On virtually all current computers, a byte is the smallest 
natural unit that can be compressed efficiently in terms of storage, communication, and in-memory data manipulation. 
Though the term "data file" often refers to a file when stored on-disk, the present invention also allows such a sequence 
of bytes to be some segment of main memory. 

Figure 1 shows an example of using the present invention to keep data in synchronization between two computers. 

is First, on the source computer, the two versions of the data, VERSION1 and VERSION2, are compared to produce a 
transformation that takes VERSION 1 to VERSION2. This transformation is transmitted via some communications chan- 
nel to the target computer. TTien, on the target computer, the transformation and the local copy of VERSION1 are used 
to reconstruct VERSION2. 

20 Coding and Decoding Transformation Instructions 

The transformation computed by the present invention consists of a sequence of two types of instructions, COPY 
and ADD. During the reconstruction of VERSION2, the COPY instruction defines the position and length of some existing 
segment of data to be copied while the ADD instruction defines a segment of data to be added. Figure 2 shows an 

25 example of two data files in which VERSION1 consists of the sequence of bytes "abc dab cda bed efgh" (spaces are 
added here for readability). VERSION2 consists of the sequence "abc dxy xyx yxy bedef." Thus, VERSION1 has length 
16, and VERSION2 has length 17. The transform shown in Figure 2 shows the instructions needed to reconstruct 
VERSION2 from VERSION1 . Note that we use the convention that positions in VERS ION 1 are coded starting from 0, 
while positions in VERSION2 are coded starting from the length of VERSION1 . For example, the third instruction of the 

30 transform in Figure 2 is a COPY instruction that copies 6 bytes starting from position 4 of VERSION2, which is coded 
as 20. 

Figure 3 shows the procedure of how the reconstruction of a version is carried out in general. Line 1 initializes the 
variable "n" to the length of VERSION1. Line 2 sets the current position "c" in VERSION2 to zero. Line 3 starts a loop 
that is terminated on line 6 after the end-of-f ile condition is detected in line 5. Line 4 calls the function readinstO to read 
35 an instruction. Line 7 reads the copying size or the data size using the function readsizeO- Lines 8 and 9 check to see 
if the instruction is an ADD instruction and, if so, reads the data into VERSION2 starting at the current position c. Lines 
10 to 15 process a COPY instruction by reading in the position code, then performing the copy operation either from 
VERSION1 or VERSION2, as appropriate. Line 16 increases the current copy position in VERSION2 by the length of 
the newly reconstructed data. The copyO function is a simple function to copy data from one area of disk memory (or 
40 main memory) to another. However, the readinst(), readsizeQ, readposO, and readdataQ functions must be defined, 
based on some concrete definitions of how the COPY and ADD instructions and their parameters are encoded. 

Applying the procedure of Figure 3 to the example of Figure 1 , we see that there are four steps in the decoding. 
The first step copies four bytes "abed" from VERSION1 , starting at position 0. THe second step adds 2 data bytes "xy". 
The third step copies from VERSION2 6 bytes starting at its position 4 (counting from 0 and coded as 20 by our con- 
45 vention). Note that at the start of this step, only the first 6 bytes "abedxy" of VERSION2 have been reconstructed as only 
the two bytes "xy" are available to copy. However, since data is copied from left to right, whenever a byte is to be copied 
it will have been constructed. The fourth and final step copies the 5 bytes "bedef " from position 9 of VERSION1 . 

We now give a description of the encoding of COPY and ADD instructions. This particular embodiment of these 
instructions are chosen since in the Inventors' experimentation they perform well for many different types of data. Given 
so the description, the readinstQ, readsize(), and readposO functions above can be straightforwardly implemented. Each 
instruction is coded starting with a control byte. TTie eight bits of a control byte are divided into two parts. The first four 
bits represent numbers from 0 to 1 5, each of which defines a type of instruction and a coding of some auxiliary information. 
Below is an enumeration of the first 10 values of the first four bits: 
0: an ADD instruction 
55 1 ,2,3: a COPY instruction with position in the QUICK cache; 

4: a COPY instruction with position coded as SELF; 
5: a COPY instruction with position coded as difference from HERE; 
6,7,8,9: a COPY instruction with position coded from a RECENT cache. 
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The QUICK cache is an array of size 768 (3 x 256). Each index of this array contains the value p of the position of 
a recent COPY instruction such that p modulo 768 is the array index. This cache is updated after each COPY instruction 
is output (during coding) or processed (during decoding). A COPY instruction of type 1, 2, or 3 will be immediately 
followed by a byte whose value is from 0 to 255 that must be added to 0, 256, or 512, respectively, to compute the array 
5 index where the actual position is stored. 

A COPY instruction of type 4 has the copying position coded as a sequence of bytes. 

A COPY instruction of type 5 has the difference between the copying position and the current position coded as a 
sequence of bytes. 

The RECE NT cache is an array having 4 indices, and stores the most recent 4 copying positions. Whenever a COPY 
w instruction is output (during coding) or processed (during decoding), its copying position replaces the oldest position in 
the cache. A COPY instruction of type 6 (respectively 7, 8, 9) corresponds to cache index 1 (respectively 2, 3, and 4). 
Its copying position is guaranteed to be larger than the position stored in the corresponding cache index and only the 
difference is coded. 

For the ADD instruction and COPY instruction of type from 1 through 9, the second 4 bits of the control byte, if not 
is zero, code the size of the data involved. If these bits are 0, the respective size is coded as a subsequent sequence of bytes. 
It is a result of the encoding method that an AD D instruction is never followed by another ADD instruction. Frequently, 
an ADD instruction has data size less than or equal to 4, and the following COPY instruction is also small. In such cases, 
it is advantageous to merge the two instructions into a single control byte. The values from 10 to 15 of the first 4 bits 
code such merged pairs of instructions. In such a case, the first 2 bits of the second 4 bits in the control byte code the 
20 size of the ADD instruction and the remaining 2 bits code the size of the COPY instruction. Below is an enumeration of 
the values from 1 0 to 1 5 of the first 4 bits: 

1 0: a merged ADD/COPY instruction with copy position coded as SELF, 
1 1 : a merged ADD/COPY instruction with copy position coded as difference from HERE; 
12,13,14,15: a merge ADD/COPY instruction with copy position coded from a RECENT cache. 
25 Figure 4 shows an encoding of the four instructions of the transform shown in Figure 2. For each instruction, all 
eight bits of the control byte are shown. For example, the first four bits of the second control byte are zero, showing that 
the byte codes an ADD instruction. The second four bits of the same byte show that the size of the ADD instruction is 
2. The two data bytes "xy" come after the control byte. All three COPY instructions are coded using the SELF type, 
meaning that their copying positions are coded in bytes (with shown values) following the control bytes. The size param- 
30 eters of all the instructions are small enough so that they can all be encoded inside the control bytes, This small example 
shows that VERS10N2 which is 17 bytes long can be coded in a transformation using only 9 bytes. 

Fast Computation of Matched Segments 

35 Figure 5 shows the method to partition VERSION2 into segments and encode them as COPY and ADD instructions. 
Note that, for this encoding method, matches of short lengths are not useful because they take up at least as much 
space to encode as the data that they match. So the matching method can be tuned to ignore short matches. The 
minimum match length that we use is 4 and represented by the variable ryllN in the body of the encoding procedure. 
Line 1 of Figure 5 initializes a search table T to empty. For efficiency, T is kept as a hash table with chaining for 

40 collisions. This data structure is standard, and is described in any data structure and algorithm textbook, such as pages 
111 - 112 in "The Design and Analysis of Computer Algorithms" by A. Aho, J. Hopcroft, and J. Ullman, published by 
Addison-Wesley, 1974. 

Table T contains certain selected positions in the two versions. These positions are inserted with the procedure 
insert() and used in the procedures searchQ and extendO for fast searching of longest matched data segments. Lines 

45 2 and 3 call the procedure process() to select positions from VERSION1 and VERSION2 to insert into the table T COPY 
and ADD instructions are also generated during the processing of VERSION2. 

Lines 4 to 45 define the procedure processO- Lines 5 and 6 initialize the variables "n" and "m" to the length of 
VERSION1 and the version being processed. Line 7 initializes the curent position "c" of the version being processed to 
0. Line 8 initializes the start of data for an ADD instruction to -1 (ie, none). Lines 9 and 10 initialize the position and 

so length of the longest match for the data segment starting at position c Lines 1 1 to 42 define the main loop that process 
the given version. Lines 12 to 18 compute a longest, already-processed data segment that matches with the data seg- 
ment starting at c. The procedure searchO called on line 12 finds a match of length len+1. This procedure uses MIN 
bytes starting at position c+le n -(M I N- 1 ) as a key to search for a matching position in the table T. Then it matches backward 
the data in "seq" and the data in the appropriate version to see rf the match covers everything from c to c+len+1 . 

55 If such a match is found, the procedure extendQ called on line 16 extends the match as far forward as possible. 
Lines 14 and 15 correspond to the case when there is no match and we break out of the search loop. Otherwise, the 
loop is repeated to find a longer match. Lines 19 and 26 insert the current unmatched position c into the table T. 
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Note that the actual value to be inserted is c if seq is VERSION1 ; otherwise, it is c plus the length of VERSION1 
(which is the convention for encoding positions in VE RSION2 that we described earlier) . The procedure insert(T,seq,p,ori- 
gin) inserts the coded position p+origin into table T using as its key. MIN bytes starting from position p in version seq. 

Lines 20 and 21 set the variable add to c, if it is not yet defined, to indicate that this is the beginning of a segment 
5 of unmatched data. Line 25 moves the current position forward by 1 for the next iteration of the processing loop. Lines 
27 and 28 correspond to the event of finding a longest matched segment. Lines 28 and 29 call the procedure wrrteinstQ 
to write out the COPY and ADD instructions according to the description given earlier. 

The first two arguments to writeinstO define the data for an ADD instruction if add is zero or positive. The second 
two arguments define parameters for the COPY instruction. The working of this procedure is straightforward so we shall 
w omit its description. Lines 30 to 36 insert into table T MIN-1 positions at the end of the matched data segment. Lines 37 
and 38 increase c by the length of the match, and resets add to -1 . Lines 40 and 41 terminate processing if there is not 
sufficient data to be processed. Lines'43 and 44 output any final unmatched data from VE RSION2 as an ADD instruction. 

Figure 6 shows a procedure to insert a position into the table T Line 2 of Figure 6 indicates that the key is the MIN 
bytes of the sequence "seq" starting at the position p. Line 3 constructs the coded position. Line 4 inserts the pair (key, 
is pos) into the table T. 

Figure 7 shows a procedure to search for a match. Lines 3 and 4 construct the search key, which consists of MIN- 
1 bytes at the end of the current longest match length, plus a new unmatched byte. Lines 5 to 19 try to extend the match 
length if possible. This is done by looking at every element of the table T that matches the constructed search key and 
seeing rf the part of the current match left to the key position matches with the corresponding part of the element being 
20 considered. This test is carried out on line 17. If this is true, then search() returns the starting position of the match on 
line 18. Line 20 returns "-1" to indicate that there is no match longer than "len". 

After the call to searchO is successful on line 13 of Figure 5, the match length is now known to be at least 1 more 
than the "len" value in Figure 5. Figure 8 shows the extendO procedure, which extends the match to the right as far as 
possible. Lines 2 to 10 set up the correct sequences to search for matches, lines 1 1 to 13 perform the extension, line 
25 14 returns the entire matched length. 

When applied to the example of Figure 2, the above method will compute exactly the set of instructions exhibited 
in the same figure. Figure 6 shows the positions in the example VERSION1 and VERSION2 that would be inserted into 
table T. 

30 Security Enhancement 

Given two versions, VERSION1 and VERSION2, and a computed transformation, only the ADD instructions in the 
transformation carry raw data from VERSION2. Such data can be utilized by a snooper to gain valuable information 
about VERSION2. In applications having high level of security requirements, to prevent leakage of information, the ADD 

35 instruction can be modified as follows. First, each ADD instruction is modified to also have a copying address which 
would be some position randomly selected from VERSION1 in such a way that the data segment starting at that position 
is at least as long as the length of the ADD data. If this is not possible, the ADD data can be broken into smaller units. 
Then, the raw data is xor-ed with data from such a selected segment of data before output to the transformation. For 
example, using the same ADD instruction in Figure 2, if the selected position in VERSION1 was 2, then this position 

40 would be output immediately after the control byte, and the two data bytes "xy" would be xor-ed with the two bytes "cd" 
before output. 

On decoding, the same xor operation must be done to each data byte before outputting. This works because the 
mathematical property of xor guarantees that when a byte is xor-ed twice with another same byte, it retains its original 
value. However, we can now guarantee that a snooper will not be able to gain any information from the transformed data 
45 bytes unless he or she already has a copy of VERSION1 , which was assumed to be secure. 

Figure 7 shows the instruction of Figure 4 encoded using this more secure method. The ADD instruction now has 
a position 2. The data bytes Y and y are shown being xor-ed with V and "d M respectively. 
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APPENDIX 
(24 pages) 



I ocrgorine . zoo att com! /n/orvphor./a? /xpy/Bof *vm rfi /ir=/I!hA"! e>.i - vj&lZfl 

•ifndef _vd ELIJAH 
•define _VDELT\J* 1 

•ifndef kpv 

•define KPV__ l 

•ifadef _sts_c 

• if d»f _9TDC_ 

•define STS_C 1 

lelae 

•if cplusplua 

•define 9TD.C 1 

• elao 

•define STD_C 0 

•cndif /* cpluaplua*/ 

tendif /'^STDC^ •/ 
•endif /• STD_C»/ 

•ifndaf _BEGIM_EXTERNS_ 

• if cpluaplua 

tdeflne _BEGIN_EXTERNS_ extern "C ( 
•define _END„EXTERN9_ J 
telae 

idefine JEGIN.WTERNS^ 
•define _END_SXTERNS__ 
•endif 

•endif /♦_BEGIN_EXTERNS_V 

•if ndef _ARC_ 

• if STD_C 

•define _ARC_{x> x 
•elae 

f define _ARG_{x) () 
•endif 

•endif /*_ARG_V 



•ifndef Vold_t 

•if STD_C 

fdefine Void^t 
•else 

•define Void_t 
• endif 

ttendil /•voloUtV 



void 
char 



•ifndef NIL 

•define NIL (type?) <(typ«)0) 
•endif /*NIL»/ 

•endif /*__KPV ♦/ 

/* ueer-eupplied function* to do lo •/ 
typedef atruot _vddiao„o vddiao_tr 

typedef ixit(» vdio^f ) - ARfl_( (int, Voi<L.t*, int, long, vddiac. 
atruct _vddiBO_a 

{ vdlo^f readf ; /* to reed data •/ 

vdio_f writef; /• to write data ♦/ 

long window; /• window size if any •/ 

)/ 
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I P «rftgT"_nft.*oa *ff eomi /n/arvphQn/o7 /kpv/Sof ^varn/ars/lib/vrlgLta/vdelra . h 

0; /• typee that can be given to the 10 functions */ 

1: #define VD_SOU*CE 1 /* lo on the source data */ 

2: »defi'na VD.TXRCET 3 /• io on th« target da^a •/ 

3: ^define VDJDELTA 3 /♦ io on the delta data V 

S: /* magic header for delta output */ 

6: tdeflne VDJ4ACXC "vdOl" 

18: _BEGIN_EXTERK9_ ' 

i$: extern long vddelta _ARG_< (Void^t* , long, void_f. long, Vddisc^t* ) ) : 

'0: extern long " vdupdate _>RG_( (Void_t» , long, Void_t*, long, vddi3c_tM > .* 

' 1 : _END_EXTEILVS_ 

'3; #endif / * _ VD El T A_H • / 
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5 I perejrinn.ZQQ.ftr.r comt /n/qrvphQn/o7/kDv/s Q ftv^r, Argyll h/v r: e i> a /v- e :hr:r h i 

1: •ifrvdef _VDELHDR_H 

2: "define _VDELHDJL.H 1 

3 : 

4t •include "vdelta.h" 

5: 

10 6 : «if STD_C 

7: « include <stddef.h> 

8t telle 

9: • include <aya/typee.h> 

10 : #endif 
. 11: 

12 i tifdef DEBUG 

15 13: _BEGIN_EXTERtfS, 

14 : extern int abort ( ) ; 

15 j _EHD_EXTERMS_ 

16: #define ASSERT(p) ((p) 7 0 : abort()) 

17s •define DBTOTAX (t,v) ( (t) +- (v) ) 

IB: "define DBMAX (m, v) ((m) ■ (m) > (V) ? (m) : (V) ) 

19: noise 

20: tdefine ASSERT(p) 

21: •define DBTOTAL{ t , v) 

22: ^define OBMAX(m.v) 

23: iendif 
24: 

23: /* ahort-hand notation* •/ 

26: tdefine rag regieter 

27t • define uchar unsigned char 

28 i ^define uint unsigned int 

29 i tdafina ulong unalgned long 

30: 

31 i /* default window aize - Choaen to auit malloc( ) even on 16-bit machines. */ 

32: #dafina MAXINT ( ( int) ( ( ( uint ) -0 ) » 1)) 

30 33: •define maxwindow ( (int)<( (uint)-O) » 2)) 

34: •define DFLTWINDOW (MAXWINDOW <• (1«14) 7 ( 1«14 ) : (1«16> \ 

35: •define HEADER (w) ((w)/4) 

36: 

37: •define M_MIN 4 /• min number of by tea to match */ 

36: 

39 » /♦ The hash function la a CO J *alpha"3 + a [ 1] * alphas + n(3]*»Tpha t 8 rj] */ 

35 40 i •define vlpha 33 

41: iif 0 

42: tdafine Al{x,t) (ALPHA*(x)) 

43: tdafine A2(X,t) ( ALPHA* ALPHA* { x ) ) 

44 i fdeflne A3(X,t) (ALPHA* ALPHA* ALPHA* (x J ) 

45: «else /• feet multiplication using ahifteiadda •/ 

46 1 «define Al(X,t) ((t - (x))« (t * (t«5)) ) 

47: "define A3<x,t) (<t - (X) ) . <t + (t«6) ♦ (t«10)) ) 

48: »define A3(x,t) <(t ■ (X)), (t r (t«3) t ( ( tr ( t«4 ) ) «6 ) ~ ( ( t»< t«4 ; 

) 

49 t landlt 

50: «define HINlT(h,a,t) ( (h - A3 (a (0] , t) ) , (h t- A2 (a ( 1] , t) ) , (h -• Al{ a £ 2 J . z ; -a [ 3 ] ) 

) 

45 51i »dafine RNECT(h,e.t) ((h •- A3(s[ -I] , t) ) , (h - Al(h,t> * a[3]) ) 

53 i 

53: tdafine EQUAL { a , t ) <<e)[0] — (t)(0j &* (s)(l] — (t)[l] 64 \ 

S4: • (e)C2J — (t)[2J t& (a)(3] — (t)[3] ) 

55: 

56 i /• Every instruction will atart with a control byte. 

57: »• For portability, only 6 bita of the byte are uaad. 

50 
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are used as follows: 
aaaa 

• of data Involved. 

s defines 16 Instruction types: 
an ADD Instruction. 

2,3: COPY vith X.QUICK addressing schs.T* . 

5; COPY with X_SELF,K_HERE addressing schemes. 

7.8.9: CO** with K_RECENT addressing scheme. 

For the above types, ssss if not zero codeo the size: 
otherwise, the size is coded in subsequent bytes. 

.11: merged ADD/COPY with K_SELF. X_HERE addressing 

.13.14,15: merged ADD/COPY with X ..RECENT addressing. 

For merged ADD/COPY instructions, sees is divided into *cc aa" 
where cc codes the size of copy and aa codes the s-.ze of 



#define VD.BITS 

f define S_BIT9 
•define I_BITS 



8 /* • bits usable in a byes 

4 /* bits for the size field 

4 /* bits for the instruction type 



/• The below macros compute the coding for a COPY address . 

*• There are two caches, a "quick" cache of (K_QTYPE»256) addresses 

** and a revolving cache of R_RTYPE "recent'* addresses. 

First, we look in the quick cache to see if the address is there. 
•• If so, we use the cache index as the code. 
*• Otherwise, we compute from 0, the current location and 

** the - recent " cache an address that is closest to the being coded Address, 
** then code the difference. The type is set accordingly. 
* * 

An invariance ia 2 # K_MERGE + K — QTYPE - l 16 . 



t define K_RTYPE 

•define K_QTYPE 

•define kjierge 

•define KJ3SIZS 

•define K.QUICK 

•define K_SELF 

•define k_here 

•define K_RECEKT 



4 /• # Of K_RECENT types 

3 /* # of K.QOICK types 

(K_RTYPE*2) /• » Of types allowing add -copy 

<K_3TYPE«VD_3ITS> /* size of K_QUICX cache 



1 /• start of K_QUICX types 

{K_QUICK+K_QTYPE) 

( K_HERE+1 ) /• start Of K_RECENT types •/ 

■define K^DDECL ( quick , recent , rhsre ) /• cache decls in vdelta 

int quick[R_Q8IZEl ; int recent (R_RTYPE) ; int rhere/» ; */ . 
• define K_CDECL( quick, recent, rhe re) /• cache decls in vdupdate 

long quick ( ; long recent (K_RTYPE) ; int rhere/*;"/ 
•define K_XNXT (quick, recent , rhere) \ 
{ quick [rhere-0] - (1«7); \ 

< K.QSIZE) quick I rhere 1 - rhere * (i«7); \ 



V \ 

V \ 



while ( (rhere +- 1) 
recent ( rhare^O ] - (1<<8); \ 
whil'e( (rhere +- 1) < K_RTYPC ) recent [rhere] 



) 

•define K_UPDATE( quick, recent, rhere, copy) \ 
{ quick ( copy %K_QSIZE] - copy; \ 

if ((rhere i> >- k_RTYPE) rhere - 0; 

) 



(rhererl)*{l«8) ; \ 



recent [rhere] - copy: \ 



•define V0_:SC0PY(k ) 
•define K_ISMERGE(k) 



((X) 
((*> 



0 44 !k) < (JUIECEKT-K.RTYPE) ) 
• (K_RECEN7*K_RTYPE} ) 
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'.'dalrs- y 



•define ASSIZE 

•define A_X3I.CCAI.<a) 

•define A^LPUKe) (a) 

•define A_?OT(s) ((e) 



( (1«3_BIT3)-1) /• max local ADD size 

((*) <- ) /* can be ceded Iccaliy 

/• ceded local value 

<A_SIZE+1) ) /« coded normal value v 



V 



•define A_ISHERE{1) {{1) & A_SIZE) 

•define A_IGET(i) <(i> ■ ASSIZE) 
•define A_GET<s) ((e) + (A^SIZE+D ) 



/* locally coded s^:e. 



V 



• define C_SIZE ( ( 1«S_BITS ) ^M^IN- 2 ) /• max local COPY iize 
•define C_ISLOCAL ( ■ ) (<•) <- C_SIZE ) /• car. be coded Iccallv 
•define C_LPUT(s) ((•) - (M_MIN-1) ) /* ceded local value 
•define C_PUT(s) <(g) • <C_SIZE*1) > /* coded normal value 

• define C_I3HERE(i) ((i) ft ( (1«3_BITS ) •!) } /• size was coded local 

• define C_I,GET ( i ) (((i) ft ( ( 1«3_BITS ) - 1 ) ) r (M_MIN-1) ) 
•define C_GET(a) ((e) ♦ (C_3IZE*1) ) 

•define K_PUT(k) ((k) « S_BXTS) 

• define K.GEKi) ((i) » 3_BXTS) 

/* coding merged ADD/COPY instruction* »/ 

•define A^rXNY 2 /• bits for ciny ADD •/ 

•define AJTINYSIZE (1«A_TINY) /• max tiny ADD size •/ 

•define A^ISTINYfe) ((») <- A.TINYSIZE ) 

•define AjrPUT(s) ((«)-!) 

•define A_TGET(i) (((i) ft (A_TI.VYSIZE- 1) ) + 1) 

•define C.TINY 3 /• bite for tiny COPY 

•define CJTIKYSIZE ((1«C_TINY) ' H^MIN-l) /* max tiny COPY size 

•define C_ISTTNY(e> ((»> <- C.TIKYSIZE) 

•define CJTPUT(s) (((e) - M_MIN) « A_TINY) 

• define C_?GET( i ) ((((i) » A_TINY) ft ( ( 1«C_TINY) ■ 1) ) - ; 
•define K_rpux(k) ( ( (k>*K^MERGE) « s_bix3> 

• define MEMCPY ( to , from, n ) \ 

•witch(n) \ 

{ default: memcpy( (Yoid_t» )to, (Void_t* ) from, ( Bize_t)n) ; \ 
to n; from *• n; break; \ 
case 7 : »to*+ • •from**; \ 
caee 6 : *to*+ - •from**; \ 
case 5 : •to** - •from**; \ 
caee 4 : •tot* - •from**; \ 
case 3 \ *to** ■ •from**; \ 
caee 2 t *to*+ • •from*~; \ 
caee 1 t "to** - •from**; \ 
caee 0 : break; \ 

) 



/* contir.ua tier. 
/* get lowjr bits 



/* Below here ie code for a buffered I/O subsystem to speed up I/O •/ 
•define I.9HIFT 7 
■ define T.J40RE (1«I_SHIPT) 
•define I_CODE(n) ( (uchar) < (n) &( I_MORE- 1) ) ) 

/* structure to do buffered 10 ♦/ 
typedef struct _vdio_e 
{ uchar* next; 

uchar* endb; 

vddlac.f disc; 
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long 
uchar 
} Vdio.t; 



ho re ; 

buf U024] ; 



•define READF(lo) <( to ) ->diac->reedf ) 

• define WRITEP(io) { ( io ) - >dlto- >writef ) 
f define 3UF(io) ((ioj->buf) 
•define BUPSIZE(io) a izeof ( ( io ) - >buf ) 
•define NEXT (io) <<io)->next) 

• define END8< io) <(io)->endb) 
•define DISC (io) <(io)">diac) 
•define here ( io) ((lo)->here) 

•define RINIT< io, dlac) {(lo)->endb - (\io)->next » (io)->buf), \ 

(io)->here - 0/ (io)->di»c ■ (disc) ) 
•define winxt< io,diac> ( ( io) ->endb * (uo)->next » <io)->buf! * BUFSIZSt io ) , \ 
(lo)*>here * 0, (io)*>disc - (diac) } 



•define REMAIN (lO) 
•define VDPUTC(io.c) 

•define VDGETC(iO) 



(ENDB(io) - KEXT(io)) 

((REMAIN(io) > o || (•.vdflebuf > (io) > 0) 
(int) (• (io)->next-- - (c)) : -1 ) 
((REMAINUO) > 0 II <«_vdfilbuf )<lo> > 0) 
<int) ( • ( io) ->r.ext-»-> : -1 J 



7 \ 



typedef struct _vdbufio_a 

{ int<* vdf ilbuf )_ARG.( (Vdio.f) ) ; 

int(* vdflabuf >_ARG_{ (Vdio.t*) ) ; 

ulong (• vdgetu)_ARG_( (Vdio_t*, ulong)); 

int( • vdputu)_ARG_( (Vdio_t*, ulong) ) ; 

int(* vdreadj^ARG^j (Vdio_t*, ucharV int)); 

i»t<» vdvrite}_ARG_< (Vdio.t*, ucher* , int)); 
} Vdbufio_t; 

•define _VdfUbuf _Vdbuf io, vdf ilbuf 
•define _vdflabuf _Vdbuf io. vdf labuf 
•define _vdgetu _Vdbuf io . vdgetu 

•define _vdputu _Vdbuf io. vdputu 

•define J/dread _Vdbuf io . vdread 

•define _Vdvrite J/dbuf io. vdwrite 



_5EGIN.EXTER.SS. 
extern Vdbufio.t 
extern void_t« 
extern VoicLt* 
extern void 
_END_EXTERNS_ 



_Vdbufio; 

raemcpy _arg_( (Void.t* , 
malloc _ARG_< (aiae_t) ) 
free _ARC_( (Void_t» ) ) ; 



conat void_t», oize_t>); 



• endif /*_VDELHDR_HV 
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i paracrine, too, atr.com; /r./arvohon/o? /kov/Sof twsre /srr /lib/ydelta/v-.r> ; - 
•includo "vdelhdr.h" 

/• Compute a trans format ion that takes source data to target data 

Written by (Kiero- ) Phor.g Vo, kpvSraaaarch. att . cam. 5/20/94 



*ifdef DE3UG . 

long S_copy, S_add; /• amount of ir.put covered by COPY and A~: 

»ong N_copy, s_add: /* » of COPY and ADD instructions 

long M_copy, M_add; /• max size of a COPY or add instruction 

long N_merge; /* • of merged instruction* 

•endlf 

•define mergABLE ( a , c , k ) ((a) > 0 tfc A_ISTIWY(a) && \ 
(C) > 0 66 C_XS?I5nf(c) 6& \ 
(k> >- K_SELF ) 

typedef struct _match_s Hatchet; 
typedef struct _table_a Table_t: 
struct _match_s 



V 



22 


{ Match_t* 


next; 


/• 


linked liat ptr 


V 


23: J; 










24 


struct _table_> 










25 


{ vdio_t 


io; 


/• 


io structure 


•/ 


26 


uchar* 


arc; 


/• 


source atring 


V 


27 


int 


n_srci 
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uchar* 


tar; 


/* 


target string 


V 


29 


int 


n_tar: 








30 


k_ddecl (quick , recant , rhert ) ; 


/* 


address caches 


V 


31 


Match_c* 


base; 


/* 


base of elements 


V 


32» int 


size; 


/• 


size of hash table 


V 


33 


Match_f* 


table ; 


/* 


hash table 


V 



}; 

/* encode and output delta instruct iona •/ 
•if STD.C 

static vdputinat(Table_t* tab, uchar* begs, uchar* here, Match^t* match, ir.t r^copy 
■ else 

static vdputinst ( tab, bags, here, match, n_copy) 
Table.t* tab; 

uchar* begs; /* ADD data if any */ 

uchar* here; /* current location •/ 

Match_t* match; /• beat match if any */ 

int xucopyi /♦ length of match •/ 

•endif 

( 

reg int xuadd, i_add, i_copy, x_type: 
reg int n, c_addr, copy, best, di 



n_add - begs ? here-begs : 0; 

c_addr - < here- tab- >tar >+taJD->n_arc ; 
k-type ■ 0i 



/• add size 

/* current address 



• / 



if (match) /• process the COPY instruction */ 

{ /**/DBTOTAL(N_eopy, 1) ; DBTOTAL ( S_copy , n^copy ) ; DSHAX(M_ccpy , r._cc?y > ; 



best - copy - match 
k_type - R_SELFj 



tab->base; 
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wed Sep 29 08:36:11 1994 

Sftrftqrir.1 zoo att . nom; /n/orvDhQn/a7/kov/sof tw^/src/lib/vd*! -a/vriri» • , 

if((d - c_addr - copy) < beet) 
( beat • d; 

k_type • K_HERE; 

> 

far{r. - 0; n < K_RTYPE; 

( lf((d - copy - tab->recent (n} ) < 3 . d >- best) 

continue; 
beat - d; 

*_type • K_RECENT-*n; 

J 

If (beet >• X^MORE && tab->quick(n ■ copv%K_QSIZE] copy; 
{ for(d - K,QTYPE-1: d > 0; --d) 

if<n >- (d«VD_BlTS) ) 
break; 

beet • n - (d«VD_BITS); /••/A3SERT;best < (1«VD_3ITS) ) ; 
k_type - K_QUICK*d; 

) 

/«*/ASSERT(be«t >- 0) i 

/**/ASSERT( (Jc.type-fK^MERCE) < (i«I_3ITS> );. 
/* update addreea caches */ 

K_CPDATE( tab- > quick, tab- >recent , tab- >rhere , copy ) ; 

/* aee if margable to laat ADD instruction */ 
if(MERGABLE<n_add,rucopy.k_type) ) 
{ 



) 

else 

( 



/••/D5TOTAI<N_merge, 1) ; 
i_edd • K_TPUT(k_type) , A-TPUT ( n_add ) , C_TPUT<n_copy ; ; 



i-copy - K_PUT(k_type) ; 
if (C_X9L0CAX(n_copy) ) 

i_copy I- c_LPDT(n_copy) ; 



if(u_add > 0) 

{ /**/DBTOTAL(N_add, 1) ; DBTOTALf S_add, a_add) ; DBMAX ( M_add , n_add ) ; 

tf ( * MERC AB L E ( n_add , n^copy , k_ ty pe ) ) 

l_edd - A_ISLOCAL(n_add) ? A_LPUT( n_add) : 0; 

if (VDPUTC((Vdio_t»>tab,i_add) < 0 ) 

return -1; 
if ( tA_I9L0CAL(O_add) frfc 

<*_Vdputu)(<vdio_t«)tab, (ulong) A_PUT (n_add) ) < 0 ) 

return. -1; 

if < <V.vdvrite) < <Vdio_t«)tab, begg, n_add) < 0 ) 
return -1: 

) 

i£(n_eopy > 0) 

( if l !MERGABlfi(n_add,n_copy,k_type) eft VDPUTC{ (Vdio_t« ) tab, i_ copy ) < 0 

return -1; 

if ( ' C_I3LOCAi ( n_ccpy ) &fc 

C_Vdputu) ( (Vdio_t*)tab, (uiong)C_PUT( n_copy) ) < 0 ) 
return -lj 
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Wed Sep 28 08:36:11 1994 

ocrearlr.e.ZQQ.att .comi /n/arvphonyo7/kpv/Sof twa~»Vqrc/:ih/^ eI-a/vdd e lt TV 

if (V_type >- K_QUICK && k_type < ( K_QVZCX~K_3TY?Z) ) 
{ if (VDPUTCf (Vdio_f: tab. ; uchar) beat; < 0 ) 

return -1; 

> 

olae 

{ tf ((*_vdputu)((Vdio_t*)tab, (ulongjteat ) < 3 ; 

return -1. 

J 

) 

else 

{ if(C_vdflabuf)((Vdio_t*)tab) < 0) 

return -1; 

) 

return 0; 



/* Fold a atring */ 
• if __STD_C 

static vdfold(Table_t* tab, int output) 
»elae 

atatlo vdfoid<tab. output) 

Table^t* tab; 

int output; 

•endif 

{ 

reg ulong 
reg uchar 
reg Match_t 
reg uchar 
reg int 
reg int 
reg uchar 
reg Metch_t 



key, n; 

♦a, *am, •ends, "as, »heade; 
*m, *liat, •curm, •beatm; 
•add, * endfold; 

head, len, n_erc • tab->n_arc; 
size - tab->eiie; 
•arc - tab->src, *tar • tab->tar; 
•baae - tab->baee. "table - tab->table; 



if ( l output) 



) 

else 



if {tab->n_arc < M_MIN) 

return 0; 
endfold • (a • arc) + tab->n_arc; 
curm - baae; 



endfold - (6 - tax) + tab->n_tar; 
curm - baae+n^arc; 
If (tab->n_tar < H_MXtf) 

return vdputinat( tab, a , endfold, NIL tKatch^t* ) ,'0 i ; 



add - NIL (uchar*); 
beatjn - NIL(Match_t« ) ; 
len • H^MIN'1; 
HINIT(key,a, n) ; 
for(;;> 

{ for< ; ; ) /• aearch for the longeat match •/ 

( lf<l(»" tableCkeyssize] ) ) 

. goto endaearch; 
liat • m - m->next; /• haad of list 

if(beota) /• akip over paat element* •/ 
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193: 
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199: 
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201: 
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208: 

209: 

210: 

211:" 

212: 

) ) 

213: 
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219: 
220: 
221: 
222: 
223: 
224: 
225: 
226: 
227: 
228: 
229: 
230: 
231: 
232: 

233 t 

234 t 
235: 
236: 
237; 



^prttarir.e.ZQQ,att.eQm:/Ti/or/Dhah/q7/kpv/SQftware/areylib/r-dii:-a/"dr! B l>- ! ir 

{ f or( ; ; ) 

{ ifjm >- oestnv+len) 

break; 

if Mm • m->next) list) 
goto endaeerch: 

) 

head - len • (M_MIN-1) ; /* header before the listen •/ 
heade - erhead; 

for(;;) 

C if((n ■ m-baaa; < n.arc) 

{ if<n < head) 

goto next; 
em » arc - n> 



) 

elee 



if ({n n_arc) < head) 

goto next; 
am • tar - n; 



next : 
) 



) 

/• make aure that the hjiih by tee match •/ 
if ( t EQUAL ( heade , am) ) 

goto next; 

/* make sure thio ie a real match */ 
for (am head. 00 - e; 80 < heade; ) 
ir ( *Bm^» i- •ee*-") 

goto next; 

aa M_#IN; 
am M_MIK; 
enda - endtold: 

if{(m-ba«e) < n_src 6ft (n - (8rcfn_aro -sr. < :er.ds-s 

enda - a+n; 
£br(; aa < enda; +*aa, --am) 
if{*am l- •se) 

goto extend; 

goto extend; 

if ((a • ra->next) — list ) 
goto endaeerch; 



extend: beatxa - m-head; 
n • len; 
len - ae*a; 

if (aa >- endfold) /* already match everything •/ 

goto endaeerch: 

/* oheok for a ionger match */ 
as MJ*IN-1; 
if (len n-H) 

HNEXT(key,ae,n) ; 
elee HINIT(key , is . :\) ; 



endaeerch: 

if (beatm) 
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249: 
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253 : 
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258: 

259 t 
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262: 
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274: 
27 5: 
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277: 
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280: 
281: 
282: 

283 : 

284 : 
285; 
286: 
287: 
286: 

285: 

290: 
291: 
292: 
293 i 
294: 
295: 
296: 
297: 



) 



( 



) 

• loa 

{ 



if (output 4& vdputir.9t( tab. add. 9 . beat::., ler.) < 0 J 
return -1; * 

/* add a aufficiant nuaiber of suffices */ 

• ads - (a len) ; 

oo - enda • <M_MIN-1); 

If ( lC»!tpUt) 

curm - base - (ss-src); 
else cura ■ baoe - n_arc • (aa-^ar:; 

lea - lOfX.N-1; 
add - .NIL(uchar«) s 
beata - NIL(Match_t« ) ; 



if ( I add) 

add 

as • 9; 
enda - (t *■ 



1 a; 
1 ) » 



/* add one prefix */ 



if(ende > (endfold - (M_MIN-1)) ) 

ends - endfold - <tU4IN-l>; 



if ( as < enda) for( ; : ) 
{ n • keyfcaize; 

if ( i (m - tableCn] ) ) 

curm->next - cunn; 

else 

( curat- >next • ai->next; 

monext • eurm; 

) 

table tn] - curmr+; 

if((ee + - 1) >■ «nd«) 

break? 
HNEXT(key,aa,n) ; 



/* add preficee/auf f icea •/ 



} 



if (a > endfold-*CMXN) 
( if{!add) 

add - 9i 

break; 

) 

HNEXT(xey,e,n) ; 



/♦ too abort to natch */ 



if (output) /* flueh output •/ 

return vdputinet (tab. add, endfold, Nii(Match_f ; ,0); 
return 0: 



• if _3Tt>_C 

long vddalta<Void_t* arc, long n_irc, void^t* tar. long n_tar. vddiac_f 

• else 

long vddeltaierc, ruaro, tax, n_tar, disc) 

VoidLt» ere; /* aource otrmg if not HULL •/ 

long n_erc; /• langth of aource data */ 



disc) 
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29B: 
299 ! 
303 
101 
2 

« w ] I 

304 

305 

306 

307 

308 

309 

310 

311 

312 

313: 

314: 

315; 

316: 

317: 

318 

319 

320 

321 

322 

323 

324 

325: 

326 

327 

328 

329 

330 

331 

332 

333 : 

334 : 

335 : 

336 : 
337: 
338: 
339: 
340 
341 
342 
343 
344 > 
345 
346 
347 
348 
349 
350 
331 
352 
353 t 
354 
355 
356 
357 



Vold_t» 
long 

Vddiic_f due; 

•endif 

( 

reg :nt 
reg long 
Table_t 



tar; /• target atrir.g If not NULL 
n_tar; /• length of target data 
/• 10 discipline • / 



size. 

?: 

tab; 



k, n, window; 



if ( idisc | | !diac->writef ' I 

( idiae->readf &fc ((n_tar > 0 ** ttar) || (ruarc > 0 && isrc) ;» » ) 
return -1; 

if(n_tar < 0) 

return 
ifcusrc < 0) 

n_arc ■ 0; 

tab.n_arc - tab.n_tar - tab. aize - 0; 
tab. tar • tab. arc - NIL(uchar*); 
tab. base - MIL (Katch_t* ) ; 
tab. table - NIL(Match_t**) ; 
wiKiT(*tab. io,diac) ; 

if (diaovindow <- 0) 

window - DFL WINDOW; 
elae if <diac->wmdow > MAXWINDOW) 

window - MAJCWINDOW; 
elae window - ( int)disc->windowj 
if ( (long) window > n_tar) 

window • (int)i\_ tar; 
if(n_erc > 0 &t (long) window > n_»rc) 

window - (int)n_ arc; 

/* try to allocate working apace •/ 

while (window > 0) 

{ /* apace for the target string «/ 

aize ■ (o-tax — 0 II tar) ? 0 : window; 
if ( (long) aire > n_tar) 

size • <int)n_tar; 
if (aize > 0 44 i (tab. tar - (uchar* jmalloc(aize«Bizaof (uchar) ) ) : 

goto reduce_windowi 

/* apace for eliding header or aource atrlng */ 
if(n_erc <» 0) /• compression only •/ 

size • tax ? 0 : HEADER (window) > 
elae /• differencing •/ 

( aize - aro ? 0 : window; . 

if ( (long)aize > n_erc) 

aiee ■ (int)n_»rc: 

) 

if (aize > 0 at ! (tab. aro ■ tuchar* )malloc(eize«eizeof (uchar) ; ) ) 
goto reduce.window ; 

/• apaoe for the ha ah table elemente •/ 
aize • window < n_tar ? window : (int)n_tar: 
if(ruarc <- 0) 

aize *- window < n_tar ? HEADER (window) : 0; 
elae aize window < n^arc ? window : (mtjn^arc; 
if ( ! (tab.baae - <Match_t* )malloc( a ize*sizeof <Match_t ) ) ) ) 
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358 

359 

360 

361 

362 

363 

364 < 

365: 

366; 

367: 

368 ; 

369: 

370: 

371 

372 

373 

374 

375 

376: 

377 j 

378 

379 

380 

381 

3B2: 

383: 

384 i 

385 i 
366 
387 
386 
389 
390 
391 
392 
393 
394 
393 
396 
397 
398: 
399 
400 
401 
402: 

403 : 

404 : 
405 : 
406: 

407 : 

408 : 
409: 
410 
411 
412 

• 413: 
414: 
415: 
416: 

. 417: 



^1-^^-2™ -ate .cam; /^/gnT hQn/q7/kpv/3oftva - ?/arc/lib/vdel - a/vdde -^ fl 

goto reduce_window; 

/« space for the hash table */ 
r. - size/2; 

dc (size • n); while((n 4- n-l) i- 0); 
if(sl2e < 64) 

size - 64; 

while( i ( tab. table - (Match_t«« )malloe ( size«eizeof (Mateh_t* ! > ) 
if < (size »- 1) <• 0) 

goto reduce.window; 

/• if get here, succesaful ■/ 

tab. size - size-1; 

break; 

reduce_windov: 

if(tab.tar) 

( freet <Void_t*)tab.tarj ; 

tab. tar - NIL(uchar« ) : 

) 

if (tab. sre) 

( free ( (Void_t» ) tab. arc) : 

tab.aro - HIL(uchar*); 

) 

if( tab. base) 

{ free( (VoidLt* ) tab. base ) ; 

tab. base - NIL(Mttch_t* ) i 

) 

if {(window »- 1) <- 0) 
return -1; 

) 

/• amount processed •/ 

n • 0; 

/• output magic bytea and eizea */ 

for(k - 0; VO^MACIClkl; k++) 

if ( (*_vdvrite) (atab.io, (uchar* )VDjiACIC,k) i- k II 
(*_vdputu) ( Atab. io. (ulong)iutar) <• o | I 
(»_Vdputu) (itab.io, (ulong)n_src) <« 0 II 
( •^Vdputu) ( 4 tab. iO/ (ulong) window) <- 0 ) 
goto done; 

/* do one window at a tixna •/ 
while (n < n_tax) 

{ /* prepare the source string •/ 

if(n_«rc <• 0) /• data compression •/ 
( if(n <- 0) 

tab.tusro - 0; 



else 

{ 



size • HEADER ( window) ; 
if (tar) 

tab. arc « tab. tar ♦ tab.n^tar • size; 
else memcpyt ( Void_t # ) tab . sre, 

(Void_r*) (tab. tar ♦ tab.r^tar - size,. 

size ) ; 
tab.n_src - site; 
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418 

419 

420 

421 

422 

429 

424 

425' 

426 

427 

428 i 

429r 

430: 

431i 

432 

433 

434 

435 

436 

437 

436 

439 

440 

441 

442 

); 

443: 

444 ! 

445: 

446: 

447 

448 

449 

450 

451 

452 

453 

454 

455 

456 

457 

458 

459 

460 

461 

462 

4 63 i 

464 

465 

466 

467 

468 

469 

470 

471 



else 
{ 



} 



J 



/* data differencing •/ 
lf(n < n^arc) 

{ if (n-rvindow > n_src) 

p ■ r._e rc- window ; 
elae ? ■ n; 
if(arc) 

tab. arc - (uchar*)erc * p: 

«lae 

{ aize - (•diae->readf ) ;vd_S0L'RCE, tab. arc 

window, p, disc); 

if (Size I- window) 
goto done ; 

} 

) /* else uae last window */ 
tab.rv.aro - window; 



/* prepare tha targat string */ 

aize - (n_tar-n) < window ? ( int ) (n_tar-n) : window; 
tab.n^tar • aize; 
if (tar) 

cab. tar - (uchar»)tar * n; 

else 

{ size - (»diac->readf > (VD_TARGET, tab. tar, aize, (long)n, disc 



) 



if ( (long) aize i- tab.n^tar) 
goto done; 



/• reinitialize table before proceaaing */ 
for(k m tab. aize; k >- 0; --k) 

tab. table [k] - NIL{Matchwt* ) : 
K_X N IT ( tab . quick , tab . recent, tab . rhere ) ; 

if (tab.ix_arc > 0 » vdfold(4tab, 0) < 0) 

goto done; 
if (vdfold{ ttab,l) < 0) 

goto dona; 

n aize; 



done: 

if ( i tar && tab. tax) 

f raa < ( Void_t* ) tab . tax ) ; 
if (tab. arc (a <{n_src <- 0 64 I tar) 

f raa ( ( VoidLt* ) tab . arc ) ; 
if (tab.baee) 

free ( ( Void_t* ) tab . baaa ) ; 
if (tab. table) 

free ( (VoioUt*) tab. table) ; 

return n; 



(r\_arc > 0 6* larc) ) ) 
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29 t 

30: 

31: 

32 1 

33 

34 

35 

36 

37: 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 
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50 

51 

52 
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56 

57 

58 

59 



i r* too att com) /n/orvphop./ * n /kay/3of tware/arc/lib/vdclt aA'dusdate 

•include "vdeihdr.h" 



/ 



Apply the transformation source ->target to reconstruct target 
This ooda is deaigned to work tvan if the local machine has 
word size smaller than that of tha wchme where the delta 
was computed. A requirement is that "long" on the local 
machine must be large enough ^o hold acurce and target air*a. 
It la aleo aaauiosd that if an array is giver., the size of 
that array in bytes must be storabla in an 'inf. This 13 
uaed in various oaat from ''long" to "lnt". 

Written by (Kiem-) Phong Vo, Jcpv3reaearch.att.com, 5/20/94 



15 


typedef struct 


_table_a 










16 


{ vdio_t 


io; 


/* 


io structure 




•/ 


17 


uchar" 


arc j 


/• 


source string 




V 


18 


long 


n_are; 










19 


uchar* 


tar; 


/• 


target string 




■/ 


20 


long 


n_tar> 










21 


long 


fl-org; 


/• 


start of window 


in source 


V 


22 


long 


t_crg; 


/• 


start of window 


in target 


•/ 


23 


uchar 


data [128]; 


/• 


buffer for data 


transferring 


V 


24 


char 


•.alloc; 


/• 


1 if source was 


allocated 


V 


25 


char 


t_alloc; 


/• 


1 if target waa 


allocated 


V 


26 


char 


compress; 


/• 


1 if compressing only 


V 


27 


K_7DECL (quick, recent, rhere) ; 


/• 


address caches 




V 


28 


) Table_t; 













• if _STD_C 

static vdunfold(Table_t* tab) 
■ else 

static vdunfold(tab) 
Table_t* tab; 
•endif 

t 

reg long 
reg int 
rag uchar 
reg long 
reg Vdio_f 
rag vddisc_t* 



size, copy; 
inst, k_type, n, r; 
•tar, *src, *to, «?r; 
Z, c_addr , n_tar, n.src; 
readf, write fj 
disc; 



rv_tar - tab->n^tar; 
tar • tab->tar; 
n_src - tab->n_srcj 
arc - tab->arc; 

disc * tab->io. disc; 
readf - disoreadf; 
writaf • disowritaf ; 

for(t - 0. c_addr ■jx.src; t < n_tar; ; 
{ if ((inst - VDCETC( (Vdio_t» jtab) > < 0) 

return -1; 
k_type - K_GET(inst); 

if { iVD_iscoPY<k_typa) ) 

( if (K_ISMERGE(k_type) ) /• merge/add instruction 
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60: 
61: 
62; 
63 i 
64: 
65: 
66: 
67: 
68; 
69 = 
70: 
71: 
72: 
73: 
74 : 
73: 
76: 
77 : 
78; 
79: 
80: 

> 

81: 
62 t 
B3: 
84; 
85: 
86: 
87: 
88: 
89: 
90: 
91: 
92: 
93: 
94: 
95; 
96: 
97; 
98: 
99: 
100: 

101: 
102: 
103: 
104: 
105: 
106: 
107; 
108: 
109: 
110 : 
111: 
112: 
113: 
114 i 
115: 
116: 
117: 
118: 



peregrine, zqq . atr. coml /n/grvphon/q7 /^v/SottvarA/arr /-i ih/./d«-. -a/yd^d^ 

size - A_TGE?< inat ) ; 
elae if (A_lSHERE<inst) ) /* locally coded ADD Size •/ 

aizm - A_LGET( ir.St ) ; 
clae /* non-local ADD size 

{ lf((eize - VDG57C( (Vdio_f)tab)) <0) 

returr. • 1; 
if (size >• I_MCRE it 

(aiz* - (long) (*_vdgetu) ( (Vdio_f ) tab, size; ) < Cj 
returr. -1: 
■it* • A_GET(slze) ; 



) 

else 

( 



V 



} 

if { (t+elze> > n_tar) 

return -1; 
c_addr size; 



/• out of aync 



/* copy data from the delta stream to target */ 

fort;;) 

( if < I tar) 



( 



} 

else 

{ 



) 



tf{(long)(n - aizeof ( tab- >data ) ) aize) 

n - (lntjflize; 
if < <*_Vdxead> ( (Vdio_f)tab, tab->data,n) !• n 

return -1; 
r - ( "writef ) (VDJTARGET, 

(Void_t* )tab->data, n, 

tab->t_org*t, disc); 
if<r ;• n) 

return -1; 



a - ( int)size; 

if ( ( *_Vdread) ( (Vdio^t* )tab, tar*t, r.) i * n) 
return -1: 



t +- n; 

if ( (aize n) <• 0) 
break; 



} 



if (K_ISMBRCE<k_type) ) 
{ aize • CjTGET(inet) ; 

Jc^type K^MERGE; 

goto do_copy; 

) 



if (C_ISXERE Unfit) ) /• locally coded COPY lize */ 

size • CJLCET(inst) ; 

else 

{ ifneilt • VDGETC((Vdio_t*)tab)) < 0) 

return -1; 
if(aize >• ZJiOtZ km 

(size - (long) (*_Vdgetu) ( (Vdio_t*) tab, size) ) < 3) 
return -1; 
size - C_GET(size) ; 



do_copy : 



if ( (t^eizej > n_tar) 
return -1; 



/• out of sync •/ 
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5 ! peregrine . zoo . att . comi /r./aryphon/ ? 7 /'<pv/ W w*/arc, lib /vo;, ti/vdugda-.ft - 

119: if ((copy • VOGETC< (Vdio_t»)tab) ) < 0) 

120: return -i; 

121: lf(k_type >« KJiUICK && ic.type < ; X_3U:CX-K_QTY?£ : ; 

122: copy - tab->quick[copy * • ; :<_type-K_3"ICX «v::_BI7S;;' 

70 123: elao 

124: { if; copy >- I_MORE 6fc 

- 25: (copy - (long) {*_VdgetU! ( (Vdlo_t« J tab. :dov> j < 

12 6: return -l: 

127 : if(fc_typa >• K_3ECENT <_type < ;X KECENT~Jt_RTY?E'. 

) 

-28; copy *- tab ■ >recant { k_typa • K_P.EC EN I ; : 

15 3-29: alse if(k_type -- K_HERE) 

130 j copy - c_addr - ccpy; 

131: /• else k_type « K_SELF •/ 

132: > 

133 : X .UPDATE ( tab- >quick, tab->racent, tab->rhere, co?yj ; 

134: c_addr — aire: 

135: 

136: If (copy < n.arc) /• copy from aourca data •/ 

137: ( if ( (copyr-axze > > n_arc ) . /• -out of ayr.c •/ 

138: return -1; 

139: if(erc) 

140: { n • ;mt)3ize; 

141: fr * src^copy; 

25 142: if(tar) 

143: { to - tar-t; 

144: MEMCPY(tO,fr,n); 

145: J 

146: else 

147: [ r - (•vritef ) (VD_ TARGET, Void.f. fr 

n, 

148: tab->t_org-t. disc;; 

149: tf(r :« n> 

150: return -1; 

131: ) 
152: t t- n; 

153: ) 
35 154; else 

155: { if ( tab->compra«a) 

156: ( copy +• tab->t_org - tab->n_src; 

157: inat • VD_TARGET; 

158: } 

159: else 

160: { copy tab->s_org; 

161: inat - VD_SOURCE; 

162: } 
163: for(;M 
164, ( If(tar) 

165: { n - ;int>sue; 

166: r - (* read* )( mat 

45 167: (Void_t* )* tar*~ : , r. 

168: copy, dia^j; 

169: } 
170: elaa 

171: ( n = sizeof ( tab- >c»ta> : 

17 2 : if; (long)n > size 



173: r. - ( int> size : 

174 j r - ( *raadf J ( lr.st 

175: (Vcid^t* ) tab->cata . n. 
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pgmynr.a. 2ca.arr .cam! / n/^phQn/aT/kDv/SQf tvare/src/lib/vcel ■ftA'CUsdaie 

176: C °P*' 
177: iUr i- n) 



178: 

179: r - : *vritef J (VD_T~RGET, 

180: 



return 
itef )( 

;Voi.d_t« ) t*°->data. r. 
tab->t__org-t , disc*; 



181: 

182: ) 

183: i*<r I- 

184: return -1; 

185: t — n: 

186: if ( (eize nj <- 0) 

187: break ! 

lea: oopy r * 

189: } 
190; ) 
191: ) 

19 2; else /• copy from target data */ 

193: { copy -- ruirc: 

194 . if (copy >- t II (oopy-size) > r._tar) /* out- of -ayr.c 

/ 

195 : return -1; 

!9$j for(;;) /* allow for copying overlapped data */ 

197: ( reg long 0, a: 

198: i£((8 • t-copy) > size) 

199: 8 • aize; 

200I if(tar) 
201: 



( to • tar^t; fr - tar+eopy; n - (lnt)a 



202- HDJCPY(to, fr, n) ; 

203: t n; 

204: 9 0t0 next; 

205: ) 
206: 

207 : /* nard read/write •/ 

208 i » * C0 PY'* 

209: for(;;) 

2X0 , { ' if(<long)(n - aixeof ( tab->data) ) > a) 

2U ! n • (int)a; 

213 ! r - ( Teadf ) <VD_T*RGET, 

3i3 ; (Void^f >tab->data. n. 



214; 

215: Lt{r I- n) 



a + tab->t_org, disc ): 



return -1; 



217 j r - (»writef ) {VDJTARGET 



218: 
219 : 

220: if l r ! " n > 



(Void^t^jtabodata, n. 
t ♦ tab->t_org, disc )• 



return *1; 

t n; 



223; if((* *" n ) <m °> 

224. break; 
225 ; a — n; 

226: > 

227: - 
238: naxt: if((iiie — S) — 0) 

229: break; 
230: ) 
231: ) 
232: } 
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233: 
234: 
235: 
236: 
237; 
238 : 
239: 
240 : 
241: 
242; 

243 : 

244 : 
245: 
246 : 
247: 
248: 
249: 
250: 
251: 
252: 
253: 
254: 

255 i 

256 : 
257: 
258: 
259: 
260 s 
261: 
262: 
263: 
264: 
265: 
266: 
267: 
268: 
269: 
270: 
271: 
272: 
273: 
274: 
275: 
276: 

277: 
278: 
279: 
290: 
281: 
282: 
2St: 
284 : 
285; 
2B6 : 
287: 
286: 
289: 
290: 
291: 
292: 



recurn 0; 

) 

-if STD.C 

long vdupdate(Void_t* arc. long o_erc, Vcid_t* tar, long n_tar, vddiac_f dice. 
*elae 

long vdupdat«(src, n_arc, tar, n_tar. diac) 

Void^t* arc; /* source string if any V 

long n_arc; /* length of arc V 

void_t» tar; /• target space if any •/ 

long rutarj /• aize of tar */ 

Vddiac.t* diac; 

•endif 

{ 

Table.t tab; 

uchar *data, roagicfS]; 
int n, r; 

long t, p. window; 
vdio_f readf, vritef; 



( ! tar it idiac->writef } j 



if(ldiac li idiaoreadf 

nturn -1; 
readf - disc->readf; 
wrttef - diac->writef ; 

/• initialize 2/0 buffer »/ 
RXKZ7(6tab. LO,diac) ; 

/• check magic header •/ 
data • ( uchar*) <VD_HAGXC) > 
for(n - 0; data(n); --n) 

if ( ( *_vdread) (4 tab. io, magic ,n) i- n) 

return -1; 
for{n 1; n >- 0; --n) 

if(data[n] i* magic [n] ) 
return -li 

/* get true target aize V 

if((t • (long) (*_Vdgetu) (*tab.io,0) ) < 0 || (tar 16 n_tar !- t) ; 

return *1; 
n_tar - t; 

/* get true source size */ 

lf((t - (long) (*_Vdgetu) (4tab. io,0) ) < 0 II (arc &s. n_sro i- t> ) 

return -1; 
n_arc • t; 

/* get window size •/ 

if ((window - (long) (*_Vdgetu) <*t*b.io,0) ) < 0) 
return -1; 

tab. compress - n_src ■« 0 ? 1 : 0; 

/♦ if we have space, it'll be faster to unfold */ 
tab. tar - tab.src - NIL (uchar* ) ; 
tab.t w alloc • tab.e_alloc - 0; 
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5 qwrnqriat , zoo ■ af.r. . aomi /n/ctrvphon/g VJoaY/SQitware /arc/lib /vdni - * /v dupcati 

29 3: if(n_tar > 0 : tar 44 window < (longjttAXIKT) 
294: n - tint; window; 

295: ela* ri - 0; 

296: . if(n > 0 44 (tab. tar - ( uchar* )malioc< n*sizeof ; uchar; ) ) ) 
297; -ab.t^alloc - 1; 

10 298: 

29 9- if(n_arc > 3 54 j arc 44 window < ( long ; MAX INT) 
300: n * ( ir.rjwir.dr; .■; 

301: el le Iffr^are •« 0 44 window < n_tar 44 itar &4 HEADER (window) < ( lonq }KAXI.VT 
) 

302: n - ( int ) HEADER (window) ; 

303: else n - 0; 

15 304: tf(n > 0 it (tab, arc - (uchar* )malloc(n*aizeof (uchar) ) ) ) 

305: tab.a_alloc - 1; 

306: 

30?: :or(t - 0: t < n_tar; > 

308: { tab.t_org - t; /• current location in target ■tream ■/ 

309: 

310: lf<n_erc — 0) /• data compreaeion •/ 

3 Hi < tab.a_org - 0; 

312: 

313: i*(t — 0) 



314: tab.ruarc • 3; 

315: else 

316: ( tab.n_arc - HEADER (window) ; 

2s 317 P ■ t - tab.n_arc; 

318: if(tar) 

319: tab. arc - (uchar*) tar - p; 

320: else if (tab. arc) 

321: { n - ( int ) tab . n_arc t 

322: If(tab.tnr) 

323: { data - tab. tar + tab.n_tar - n: 

30 3 24: roamcpy (( void_t* ) tab . arc .( Void_t* ) data 

-n): 

325: J 
326: el.e 

327; ( r . {■readf)<YD_TARGET,tab.3rc,n,p,ci 

ac); 

328: it{X i- n) 

35 329: goto done; 

330: } 
331: ) 

332 : ) 

333 : ) 

334: elaa /• data differencing •/ 

( tab.n^arc • window; 

- - i: if (t < n_arc) 

337: { if ( (t^window) > n_*rc) 

338: p - r\_9rc- window; 

339: alae p - t; 

340: 

341: tato.a_Qrg - p; 

45 342: 

343: if (arc) 

344: tab. arc - (uchar*) arc » p; 

345 : alae a.f(tab.arc) 

34 6: ( n - ( int )tab . n_arc; 

347; r - (*readf ) <VD_SOURC2, tab. arc. n, p. disc; : 

348: if{r I- n) 

50 349 : goto dona; 
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75 



20 



25 



350: 

351: 

352: 

353 

354 

355 

356 

357 

358 

359 

360 

361 

362 

0) ; 

363 

364 

365 

366 

367 

368 

369 

370 

371 

372 i 

373 ; 
374: 
375: 
376: 
377: 



) 



) 



ii(tar) 

tab. tar • { uchar* Jtar^t ; 
tab.n_tar - w: ^dov < (n_tar-t) ? window : {n_tar-t); 

K_:.vi?(tab.quicJc/ tab. recant, tab. rhere) ; 
if (vduafold(itab) < 0) 

goto done; 
if ( >tar «4 tab. tar) 

( p- ( *writef ) ( vd^TARGET, (Void^t* ) tab . tar* { ir.t ) tab , r._tar, z . dis 



} 



if(p I • tab.n_tar> 
goto done; 



t r« tab. rut ar; 



dona : 

irttab 



t_alloc) 
free ( (VoicLt*) tab. tar) : 
if (tab. «_alloc) 

free ( ( Void_t* ) tab . arc ) ; 

return t; 
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10 



15 



1: 
2: 
3: 
4 ; 
5: 
• 6: 
7: 
3: 
9: 
10: 
11: 
12: 
13: 
14: 
IS: 
16: 
17: 



. — 7 >«n«.z n r» att. nam* /n/arvshor ^7 /Vyv/Scf rware /arc /l ib, vde.lt a /rdia . C 



•include " vdelhdr . h" 



•If STD_C 

static .vdfilbuf (reg vdio_t» io) 
• elaa 

static _vdfilbuf <io> 
reg Vdio_t« : 
•endif 

( reg int n; 

if<(n - (*REXDF(10))<VD_OELTA,SUr{io).BLTSI2E(lO),KERE(iO),DISC(lo:. )) > 0) 
{ ENDB(lO) • (SEXT(lO) • BuT(io); * n; 

HERE(io) nj 



) 

return n; 



) 



20 



25 



30 



35 



40 



45 



50 



19: 

20: 

21: 

22: 

23: 

24: 

25: 

26: 

27: 

28: 

29 

30 

31 

32 

33 

34: 

35: 

36: 

37: 

38: 

39 i 
40: 
41: 

42: 

43: 

44: 

45: 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58: 

59: 



• if __9TD__C 

static _vdflsbuf (reg Vdio_t* io) 

• else 

static _vdfl»buf( io) 

reg Vdio_t« io; 

•endif 

( reg int n; 

i£((n - NEXT(io) • BUF(lo)) > 0 64 

(•WRlTEP(io))(VDJ3BLTA,BUP(iO),n,HCRE(io),DI3C(10)) I- n) 

return -1; 

HERE(io) +« n; 
NEXt(io) • BUF(io); 
return 8UFSXZE(io>; 

) 

fif _9TD_C 

static ulong _vdgetu<reg Vdio.t* io, reg ulong v) 

• else 

static -ulong _vdgetu(io,v) 
reg vdio_t* io; 
reg ulong v; 
tendif 

( reg int o 

for(v t- IJ1DRE-1;;) 

{ i£((c - VDCETC{ io) ) < 0) 

return (ulong) (- 11) ; 
if ( ! (cal^MORB) ) 

return <<V«I_9HIFT) i c): 
v - (v«I_iHIFT) I (c 6 (I_K0RC-1))J 



) 



} 



• if _3TD_C 

static _vdputu(reg Vdio_t« io, ulong v) 
•else 

atatic _ydputu(io, v) 
reg Vdio.f ioj 
reg ulong v; 
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60: #endif 

61: { 

62: reg uchar *next: 

63: rag int len; 

64: uchar cUizeof (ulong) »li ■ 

10 65: 

66: a » next " &c t aizeof : e ; -XI ; 

67 : •« - I_CODE(V) ; 

68: whiieuv »- I_9HIFT) ) 

69: »--a - X_C0DE{v) |I_>10RE; 

70: len - (nexte) - 1; 

71: 

' 5 72: if (REMAIN(io) < len &t _vdf lsbuf ( io ) <= 0) 

73: return -1; 

74: 

75: next » lO->next; 

76 : avitch(len) 

77: ( 

78: default: memcpy ( ( Void_t* ) next, ( Void_f ) a , Ion) ; next 1— len; break; 

79: caae 3: •next*-*- • *ar- ; 

80: case 2: *next>* • «at+; 

81: case 1: *next-+ - *a; 

82: ) 

83: ioonext • next; 
84: 

25 85: return len; 

86: } 
87: 

88: *if STD_C 

89 t static _vdreed<Vdio_t* io, reg uchar* a, reg int n) 
90: telae 

91: atatic _vdread(io, a, n) 
30 92: vdio.t- io; 

93: reg uchar* a; 
94: reg int n; 
95: 'endif 
96: { 

97 • reg uchar* next; 
98 i reg int r, a; 

99: 

100': for(m - n; > 0; ) 
• 101: ( if((r - REMAIK{ io) ) <- 0 6i <r - _vdf ilbuf ( io ) ) <- 0) 

102: break/ 
103: if(r > m> 

10 4 : r • ttt; 

40 . 105: 

13 6: next ■ io->next; 

107: MOiCF*<a,next,r); 
108: ip->next • next; 

109: ■ 
110: m r; 

111: } 
45 113: return n-m; 

113: ) 
114: 

113: «if _STD_C 

116: atatic _vdvrite{Vdio_t* io, reg uchar* a. reg int n) 
117: telae 
50 -i fl ' atatic _vdwrite<io, a, n) 
119: Vdio_t* io; 
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10 



15 



20 



25 



120 

131 

122 

123 

124 

125 

126 

127 

128 

129 

130 

131i 

132: 

133: 

134 i 

135: 

136 

137 

138 

139 

140 i 

141 

142 

143 

144 

145 

146: 

147: 

148: 

149: 

150: 



r«g uchar* 
r»g int 
t»ndif 

{ 

reg uchar* 
reg int 



y »r» fl ri-« * QQ att. eo a!/r/a^/DhQn/a7/kov/SQftvar H / B rc/V-b/vd e lta/vdin r 
ru- 



ne xt; 

w, ro; 



for(ni - n; m > 0; > 



lf({w - aniAIN(to)> <* 0 fi.fi. (w - _vdfisbuf< to) ) <« 0) 

break j 
if(w > m) 

w - m; 

naxt ■ io->next; 
MIWC?*(next,»,w) ; 
io->next - next; 



return n-ra; 



vdbufio_t _vdbu£lo - 
{ _vdfilbuf, 

_vdflabuf , 

_vdgetu , 

.vdputu, 

.vdreed, 

_vdwrite 

); 
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Claims 

35 

1 . In a computer, the improvement comprising: 

a) program means for producing instructions which allow replication of a second version of a binary file, based 
on a first version, without access to the second version. 

40 

2. A method of replicating a second version of a binary file, which is derived from a first version, comprising the following 
steps: 

a) creating a sequence of instructions, each of which generates a character sequence, which, when concate- 
45 nated, replicate the second version; and 

b) executing the instructions. 

3. For a digital computer, the improvement comprising: 
so a) first program means for 

i) examining a first and a second file and 

ii) producing a sequence of instructions which, when executed, concatenate 

55 A) parts of the first file with 

B) parts of the second file, without access to the second file, 

in order to replicate the second file. 
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4. The improvement according to claim 3, and further comprising second program means for executing the sequence 
of instructions, for replicating the second file. 

5. A method of saving a later version of a computer file, comprising the following steps: 

a) comparing the later version with an earlier version, and identifying 

i) similar passages, where the later version is similar to the earlier version, and 

ii) difference passages, where the later version is different from the earlier version; 

b) storing the address where each similar passage occurs in the earlier version; and 

c) storing each difference passage, together with the address of its occurrence in the later version. 

6. A process of information replication, comprising the following steps: 

a) finding, at a first site, 

i) similarities and 

ii) differences 

between a first file and a second file; 

b) maintaining, at a second site, a copy of the first file; 

c) transmitting the following to the second site: 

25 i) locations of the similarities, 

ii) the differences themselves, and 

iii) information to enable replication of the second f iie, based on (c)(i), (c)QQ, and the second file. 



10 



15 



20 



30 



7. A method of updating an old version of a file into a new version, comprising the following steps: 
a) receiving instructions which order one or more of the following to occur: 



i) copying a specified part of the old version into a specified location of the new version; 

ii) copying a specified part of the new version into a specified location of the new version; and 
35 iii) adding specified bytes to a specified location in the new version; 

and 

b) executing the instructions. 

40 8. A system for generating data indicative of differences between first and second versions of a file, comprising: 
a) means for deriving a sequence comprising the following instructions: 

i) a COPY instruction which orders that characters be copied from 

45 

A) a source location in either the first or second version, to 

B) a destination location in the second version; and 

ii) an ADD instruction which orders that specified characters be added to specified locations in the second 
so version. 
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WORD — *-When buying coconuts, moke sure that they ore crack free and 
POSITION— 1-» 2-* 3 + 5 6 7 8 9 10 11 

have no mdd on them. Shake them to make sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand, over a sink 
25 26 27 28 29 3031 32 33 34> 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 



VERSION 
1 
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VOCABULARY 
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30 hit 
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Hawaiian all 
When buyingAcocanuts, make sureASfeMfaSj are crack free and 
1 J 2-* 3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 18. 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one- hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

a bnck 

and hit it around the center *ithAfffi lllii md nt n liiii||||iu 
38 39 40 41 42 43 44 45 46 47 484950 



VERSION 
2 



FIG. IB 
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When buying iHowoiianl coconuts, make sure (3 are crack free and 
ti 2 -» 3 4 5 6 7 8 9 10 11 

Shake them to make sure that they are 
17 18 19 20 21 22 23 24 



have no mold on them. 
12 13 14 15 16 



heavy with water. 
25 26 Z7 



Mow hold a coconut in one hand over a sink 
28 29 3Q3t 32 33 34 35 3637 



and hit it around the center with 
38 39 40 41 42 43 44 



a brick 



4546 



VERSION 
2 



VOCABULARY 
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When 


16 
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11 
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no 


28 
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14 


mold 


29 
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15 


an 


30 


hit 





new 

WORDS 



FIG. 1C 
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When buying] coconuts, moke sure that they are crock free and 
T* 2~^3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 



VERSION 
1 



When buying 
2 



COPY 2 1 
INSTRUCTION. 1 



POINTER 



FIG. 1D 



When buying coconuts, make sure that they are crack free and 
1 J 2-» 3 4 5 6 7 8 9 10 11 

have no mold on them. Shake them to moke sure that they are 
12 13 14 15 16 17 18 19 20 21 22 23 24 ' 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 



VERSION 
1 



ADD 1 Hawaiian — ' 
INSTRUCTI0N.2 



When buying Hawaiian 
1 2 3 



POINTER 



FIG. 1E 
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When buying Icoconuta, moke sure! that they are crack free and 



1 J 2-» ^ 



5 6 7 a 9 10 11 



have no mold on them. Shake them to make sure that they are 
12 13 14 15 16 17 .18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the claw end of a hammer 
38 39 40 41 42 43 44 45 46 47 48 4950 



VERSION 
1 



When buying Hawaiian coconuts, make sure 
1 2 3 4 5 6 

COPY 3 3 f 

INSTRUCTION^' POINTER 



FIG. 1F 



When buying coconuts, make sure that they are crack free and 
1 J 2-» 3 4 5 6 7 8 9 10 11 

hove no mold on them. Shake them to make sure that they ore 
12 13 14- 15 16 17 18 19 20 21 22 23 24 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the claw end of a hammer. 
38 39 40 41 42 43 44 45 46 47 4S4950 



1 

When buying Hawaiian coconuts, make sure all 
1 2 3 4 5 6 7 

t 

POINTER 



FIG. 1G 



VERSION 
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ADD 1 all — 
INSTRUCTI0N_4 
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When buying coconuts, make sure that they 
1-* 2-* 3 4 5 6 7 



are crock free and 
8 9 10 11 



have no moid on them. 
12 13 14 15 16 



Shake them to make sure that they are 
17 18 19 2Q 21 22 23 24 



Now hold a coconut in one hand over a sink 
28 29 3031 32 33 34 35 3637 



heavy with water. 
25 26 27 

and hit it around the center with! the clow end of a hommer. 
38 39 40 41 42 43 44 45 46 47 48 49 50 

POINTER 



VERSION 
1 



When buying Hawaiian coconuts, make sure all are crack free and 
1-* 2-» 3 4 5 6 7 |8 9 10 11 



I have no mold on them. Shake them to make sure that they are 

112 13 14 15 16 17 18 19 20 21 22 23 24 
I 

h heavy with water. Now hold a coconut in one hand over a sink 
|25 26 27 28 29 3031 32 33 34 35 3637 
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When buying coconuts, make sure that they ore. crack free and 
1> 2-* 3 4 5 6 7 8 9 10 TT 

have no mold on them. Shake them to moke sure that they are 
12 13 14 15 16 17 18 19 2D 21 22 23 24 

heavy with water. Now hold a coconut in one hand over a sink 
25 26 27 28 29 3031 32 33 34 35 3637 

and hit it around the center with the clow end of a hammer. 
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iJ 2 J 3 4 5 6 7 8 9 10 11 



have no mold on them. 
12 13 14 15 16 



Shake them to make sure that they are 
17 18 19 20 21 22 23 24 



heavy with water. 
25 26 27 



Now hold a coconut in one hand over a sink 
28 29 3031 32 33 34 35 3637 

_ 



and hit it around the center with a brick 
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POINTER 
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VERSION f 
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VERSION 2 



FIG. 1 



VERSION 
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LENGTH 16 
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POSITION: 0 12 15 



VERSION 
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LENGTH T7 



CHARACTER; abcdxyxyxyxybcdef 
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COPY 4 0 
ADD 2 x,y 
COPT 6 20 
COPY 5 9 



FIG. 2A 
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VERS!0Nl[a bcdabcdobcdefgh 
VERSION2[q bcdxyxyxyxybcdef 



1. COPY 

TRANSFORMATION 3] JqPY 
4] COPY 



4 

2 
6 
5 



0 

x.y 

20 
9 



FIG. 



1. n = length(VERSI0N1); 

2. C = 0 

3. while(true) 

4. J inst = readlnstO; 

5. if(inst == end-of-file) 

6. return; 

7. s = rwdsize(); 

8. if(inst == ADD) 

9. reoddoto(VERSION2+c,s); 

10. else 

11. { p = readpos(); 

12. if(p < n) 

13. copy(VERSION2+c,VERSION1+p,s); 



14. 
15. 
16. 




c 



» C +• 3; 



17. ! 



FIG. 3 
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FIG. 4 
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1. Initialize table of positions T to empty; 

2. process(VERSIONI); 

3. processjVERSJONZ); 

4. process(seq) 

5. I n =* length(VERSI0N1); 

6. m = length(seq); 

7. c = 0; 

8. add = -1; 

9. pos = -1; 

10. len = MIN-1; 

11. whilst) 

12. { while(1) 

13. { P = search(T,seq,c,len); 

14. if(p < 0) 

15. break; 

16. len = extend(T,seq,c,p,len); 

17. pos = p; 

18. | 

19. if (pos < 0) 

20. j if(add < 0) 

21. add = c; 

22. if(seq *» VERSION 1) 

23. insertfr,seq,c,0); 

24. else insertfJ.seqAn); 

25. c = c + 1; 

26. | 

27. else 

28. { if(seq == VERSI0N2) 

29. writeinst(add,c,pos,len); 

30. p = c+len-(MIN-1); 

31. whiie(p < c+len) 

32- { iffseq VERSKJNT) 

31 insertft.seq.p.O); 
3A. else insert(T,seq.p,n); 

35. p m p+1 

36. | 

37. c » c + lenr 

38. add = -1; pos = -1; len = MIN-1; 

39. \ 

40. if(c >= m-MtN) 

41 . breok; 

42. } 

43. if(seq == VERSI0N2 ond add >= 0) 

44. writeinst(add,m,-1,0); 

45. | 



FIG. 5 
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1. insert(T,seq,p,orig) 

2. | key = seq[p,p+1 p+MIN-1]; 

3. pos = D+orig; 

4. Insert (key.pos) into T; 

5. I 



FIG. 6 



1. seorch{T,seq,c f len) 

2. I n = length(VERSI0N1); 



3. p * c + ten - (MfM-1); 

4. key « seqfr.p+l p+MIN-1]; 

5. for(each entry e in T that matches key) 

6. { pos = position(e); 

7. if(p >= n) 

8. | str = VERSI0N2; 

9. q = pos-n; 

10. } 

11. else 

12. j str « VERSION; 
11 q. = pas 

14. | 

15. d = q - (len - (MIN-1) ); 

16. if(d >» 0) 

17. * if(seq[c,c+1 p-lj == str{d,d+1,...,q-l]) 

18. return pos - (fen - (MIM-T) ); 

19. } 

20. return -1; 



21. I 

FIG. 7 
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1. extend(T,seq,c,p,len) 

2. { n = lenqth(VERSI0N1); 

3. if(p < nj 

4. str = VERSION!; 

5. else 

6. | str = VERSION2; 

7. p = p-n; 

8. ( 

9. m = length(seq); i « c + ten + t; 

10. n = length(str); j = p + ten + t; 

11. whilefl < m and i < n) 

12. if(seq[i] != seq[j]) 

13. break; 

14. return i-c; 

15. } 



FIG. 8 
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FIG. 9 
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FIG. 10 
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